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at  different  points  of  an  electronic  device.  The  definition  of 
influence  can  serve  the  decision  analyst  in  an  analogous  manner, 
helping  him  to  conceptualize  and  communicate  the  relationship  of  the 
probability  distributions  on  different  variables  in  a  probabilistic  __ 
decision  model.  The  definition  of  influence  supports  a  calculus  of 
influences  that  allows  one  to  compute  the  total  Influence  of  one 
variable  on  another  even  when  there  are  several  intermediate 
variables.  Using  this  influence  calculus,  the  importance  of  a 
particular  variable  to  the  decision  model  can  be  determined.  An 
Immediate  consequence  is  a  recommendation  for  which  variables  to 
include  in  the  model  and  whether  the  uncertainty  about  a  variable  is 
important.  These  recommendations  include  a  new  interpretation  of 
deterministic  sensitivity. 

An  important,  philosophical  result  of  this  research  is  the 
demonstration  that  wh'ich  variables  shouT8~be  included  in  the  decision 
model  depend  on  the  decision  maker's -cisic  attitude^ Two  decision 
makers  with  the  same  state  of  information  but  different  risk  attitudes 
should  model  the  same  decision  problem  differently. 

Finally,  the  theoretical  basis  for  the  influence  definition  is 
different  from  that  of  the  conventional  discretization  or  decision 
tree  representation  for  solving  decision  problems.  Since  the 
acceptability  of  the  influence  method  depends  on  its  accuracy  and 
ease  of  implementation  relative  to  discretization,  the  theoretical 
bases  of  the  influence  method  and  discretization  are  compared. 
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Abstract 


Tha  generality  of  the  decision  analysis  methodology 
permits  its  application  to  decision  problems  regardless  of 
the  particular  discipline  or  setting  in  which  the  problem 
occurs.  Consequently,  the  decision  analyst  may  be  unfamiliar 
with  the  relationships  of  the  variables  in  the  problem.  One 
device  for  communicating  those  relationships  is  a  diagram 
identifying  the  existence  of  influences  between  the  variables. 
This  research  contributes  a  general  mathematical  characterization 
of  the  influence  between  random  variables.  The  influence  can 
be  characterized  by  a  matrix  that  is  null  if  and  only  if  no 
influence  exists  and  otherwise  indicates  the  degree  and  type 
of  influence  by  its  nonzero  elements. 

An  electrical  engineer  uses  the  schematic  diagram  of  a 
circuit  to  conceptualize  and  communicate  the  relationship 
between  the  voltage  at  different  points  of  an  electronic 
device.  The  definition  of  *.wfluence  can  serve  the  decision 
analyst  in  an  analogous  manner,  helping  him  to  conceptualize 
and  communicate  the  relationship  of  the  probability  distribu¬ 
tions  on  different  variables  in  a  probabilistic  decision 
model.  The  definition  of  influence  supports  a  calculus  of 
influences  that  allows  one  to  compute  the  total  influence 
of  one  variable  on  another  even  when  there  are  several  inter¬ 
mediate  variables.  Using  this  influence  calculus,  the  impor¬ 
tance  of  a  particular  variable  to  the  decision  model  can  be 
determined.  An  immediate  consequence  is  a  recommendatior  for 


which  variables  to  ineluda  in  the  model  and  whether  tha  un¬ 
certainty  about  a  variable  ia  important.  These  recommenda¬ 
tions  include  a  new  interpretation  of  deterministic  sensitiv¬ 
ity  . 

An  important,  philosophical  result  of  this  research  is 
the  demonstration  that  which  variables  should  be  included  in 
the  decision  model  depend  on  the  decision  maker's  risk  atti¬ 
tude.  Two  decision  makers  with  the  same  state  of  information 
but  different  risk  attitudes  should  model  the  same  decision 
problem  differently. 

Finally,  the  theoretical  basis  for  the  influence  defini¬ 
tion  is  different  from  that  of  the  conventional  discretization 
or  decision  tree  representation  for  solving  decision  problems. 
Since  the  acceptability  of  the  influence  method  depends  on  its 
accuracy  and  ease  of  implementation  relative  to  discretiza¬ 
tion,  the  theoretical  bases  of  the  influence  method  and  dis¬ 
cretization  are  compared. 


"My  master  is  so  great  because  he  eats  when  he  is 
hungry  and  drinks  when  he  is  thirsty." 

.  .  .  part  of  a  Buddhist  Proverb 

"Uncertainty  makes  me  nervous,  and  certainty  makes 
me  unnervous." 


Mary  Hartman,  Mary  Hartman 
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CHAPTER  I 


Introduction  and  Overview 

Decision  analysis  combines  the  decision  maker's  uncer¬ 
tainty  about  problem  variables,  his  structure  relating  the 
decisions  and  outcomes,  and  his  preferences  over  outcomes  to 
obtain  a  logically  consistent  decision.  Structuring  of  the 
decision  problem  is  part  of  the  foundation  of  decision 
analysis, 

J 

-“The  primary  function  of  the  decision  analyst 
is  to  capture  the  relationships  among  the  many 
variables  in  a  decision  problem,  a  process 
called^structur  ing .  _ £*_ 

The  purpose  of  this  research  is  to  improve  the 
decision  analysis  structuring  methodology.  There  must  be  a 
decision  analysis  theoretical  foundation  for  the  method¬ 
ology,  so  that  the  resulting  structure  conduces  to  a  solution 

ji  'if 

of  the  decision  problem.  At  the  same  time,  requiredLthat 


T 

the  methodology  be  useful  for  communicating  the  relation- 

ships  in  a  complex  decision  problem.  -In  the— fellowingTwo 

<~~ oZIho  r  ~  ~  — —  _ y 

seetioRs-we-  discuss^hese  two  requirements  and  reviews' 


previous  research  related  to  each. 

/yYpJj'  i- ^  A*  *  ^  j 
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1.1  Decision  Analysis  Theoretical  Structuring 

To  be  precise  about  what  is  required  of  the  structuring 
process,  let  the  random  variable  v  represent  the  profit  and 
d  the  decision  variable.  Then,  a  decision  model  structure 
should  permit  the  computation  of  the  conditional  profit  lottery 

*  i? 

{v|d,S}.  If  the  decision  maker  believes  the  profit  lottery  . 

depends  on  a  set  s^  of  state  variables,  it  may  be  convenient 
to  compute  the  profit  lottery  through  the  expansion  equation 

(1.1.1)  {v|d,,9}  ®  j  {v|  d,  B^tS  }{s1  [dfSlds^  . 

2-1 

The  decision  maker  may  believe  that  some  of  the  variables 
included  in  s^  depend  on  other  state  variables.  Let  the  second 
set  of  state  variables  be  denoted  as  s2  .  Then, 

(1.1.2)  {v|d,S}  *  f  f  {v|d,s1,5}{s1|d,s2,5Hs2|d,s}ds2ds1 

1  2 

The  most  general  probabilistic  expansion  of  this  form  is 

(1.1.3)  {v | d,S}  =  LL  {v|d,s1,s2,5}{s1|d,s2  ,5Hs2  |d,5>ds1ds2  . 

However,  since  all  of  the  state  variables  upon  which  v  depends 

*>- 

are  included  in  ^  , 

{v|d,s^,s2,S}  =  {v|d1,s1,5}  , 
and  (1.1.3)  reduces  to  (1.1.2). 

*  The  notation  (v|d,5)  represents  the  probability  density 
distribution  on  the  variable  v  conditioned  on  the  vari¬ 
able  d  .  Since  we  take  the  subjective  view  of  probability  the 
symbol  S  is  included  to  represent  conditioning  on  a  particular 
state  of  information. 
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Ths>  expansion  of  (1.1.2)  can  be  repeated  to,  say,  sn 
until  the  decision  maker  is  comfortable  in  assessing  {sn|d,5} 
and  the  other  required  marginal  probability  distributions.  The 
resulting  expansion  is 


(1.1.4)  {v|d,5> 


U. 

-1  -2 


1" 


d,s1,5}{si 


{ sn_ ^  |  d ,  sn , S }  ...  {  Sjj  |  d , S ) ds^  d js  2  •  •  •  d  s^  *  *  *  n 

and  is  represented  in  Figure  1-1. 

Generally,  the  expansion  procedure  described  by  equation 
(1.1.4)  is  impractical,  because  it  results  in  so  many  dependencies 
between  state  variables.  If  the  expansion  above  includes  a  total 
of  k  state  variables,  then  the  number  of  possible  dependencies 
is  (k-1) J  For  complex  decision  problems,  the  cost  of  including 
every  dependency  in  the  analysis  is  prohibitive  and  unwarrantable. 

The  decision  analyst  uses  his  judgment  to  ignore  some  depend¬ 
encies  and  to  include  others  in  striking  a  balance  between  ex¬ 
cessive  detail  and  unreal  simplicity.  However,  once  we  admit 
that  the  decision  model  is  not  going  to  include  every  variable 
relationship  that  the  decision  maker  identifies,  then  we  must 

require  a  theoretical  basis  on  which  to  select  the  subset  of 

* 

variable  relationships  that  are  to  be  included.  Suppose  j!>n, 

1  £  n  £  N  ,  represents  a  subset  of  £n  , 


(1. 1. 5a)  C  J3  ^ , .  •  • ,  sn  c  sn , . . . ,  s^j  c  sN  . 

v 

Which  subsets  of  variables  sn  used  in  equation  (1.1.5b), 
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► 

» 
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I  FIGURE  1- 
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,  A  Representation  Of  The  Expansion  Equation 
Showing  The  Sets  of  State  Variables 
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best  represents  the  decision  maker's  structure,  equation  (1.1.4), 
as  the  total  number  of  state  variables  decreases? 


Review  of  Related  Work  in  the  Theoretical  Structuring  of 
Decision  Analysis  Problems 

The  purpose  of  the  deterministic  phase  of  the  decision 
analysis  cycle  is  to  provide  a  deterministic  structure  for  a 
decision  problem  and,  through  the  deterministic  sensitivity,  to 
indicate  the  important  variables  for  inclusion  in  the  probabi¬ 
listic  model.  This  procedure  is  intuitively  reasonable  and  has 
proven  successful  in  over  a  decade  of  application.  [1,6,7,9,17] 
However,  so  far  a  theory  has  not  been  presented  to  show  that 

deterministic  sensitivity  is  the  best  criterion  on  which  to 

* 

determine  the  subsets  c  s„  of  variables  to  be  included  in 
the  stochastic  decision  model.  As  a  result,  it  is  possible  to 
construct  some  examples  of  deterministic  sensitivity  that  could 
make  the  selection  of  the  stochastic  variables  ambiguous.  For 
example,  consider  a  decision  model  with  two  independent,  un¬ 
certain  state  variables  x^  and  X£  •  Suppose  the  variables 
have  identical  marginal  probability  distributions  and  different 
deterministic  sensitivities  shown  in  Figure  1-2.  If  the  measure 
of  the  Importance  of  a  variable  to  the  decision  model  is  its 
affect  on  the  expectation  of  the  profit  lottery,  then  it  is 


5 


better  to  fix  x2  at  its  mean  and  allow  x1  to  be  represented 
as  uncertain  than  vice  versa.  Because  of  the  linearity  of  i  .s 
deterministic  sensitivity,  uncertainty  about  x2  affects  the 
expectation  of  the  profit  lottery  in  the  same  way  as  it  affects 
the  expectation  of  x2  .  Hence,  only  the  expectation  of  x2  is 
required  to  model  the  expectation  o*  the  profit  lottery.  An¬ 
alytical  support  for  these  contentions  is  provided  in  Chapter  3. 

Two  early  articles  by  Matheson  [8]  and  Smallwood  [16]  demon¬ 
strate  that  one  could  use  decision  analysis  to  decide  among 
possible  decision  models.  This  approach,  however,  requires  the 
assignment  of  a  prior  probability  distribution  over  either  the 
possible  profit  lotteries  resulting  from  a  complete  analysis 
(Matheson)  or  the  space  of  possible  models  (Smallwood) .  While 
these  studies  provide  an  interesting  conceptual  tool  for  under¬ 
standing  the  structure  of  a  decision  problem,  they  have  not  been 
widely  used  in  practice,  probably  because  of  the  analyst's  reluc¬ 
tance  to  assign  the  required  priors. 

More  recently  Tani  [18]  suggested  a  variation  of  Matheson 's 
approach  that  can  be  used  to  quantify  the  dissatisfaction  with  a 
current  model.  Rather  than  encoding  a  prior  over  possible  profit 
lotteries,  Tani  uses  the  differences  between  the  current  lottery 
and  an  "authentic''  lottery,  which  is  still  a  difficult  assessment. 
Tani  assumes  that  the  marginal  probability  distribution  encoded 
on  state  variables  are  authentic. 

With  respect  to  this  dissertation,  Tani's  most  important 
contribution  is  the  establishment  of  a  philosophical  criterion  by 
which  to  judge  the  "goodness"  of  a  model.  He  introduces  the 


concept  of  authenticity  as  the  metric  for  decision  models . 

"Our  ideal  in  decision  analysis  is  not  to  construct 
the  perfect  model,  but  rather  to  obtain  the  authentic 
profit  lottery  —  the  one  that  accurately  expresses 
cur  uncertainty  about  the  future."  [18) 

An  authentic  profit  lottery  is  one  that  accurately  and  fully 

expresses  the  decision  maker's  beliefs.  We  have  shown  elsewhere 

how  an  otherwise  attractive  structuring  device  is  unacceptable, 

because  it  is  not  related  to  the  authenticity  of  the  profit 

lottery.  [131 

1.2  Practical  Considerations  in  Structure  Assessment 

Three  important  difficulties  oppose  our  attempts  to  structure 
a  decision  problem:  unfamiliarity,  complexity,  and  numerous  par¬ 
ticipants.  First,  by  unfamiliarity  we  mean  the  analyst's  unfamil¬ 
iarity  with  the  political,  technical,  and  economic  influences  in 
a  particular  decision  problem.  The  decision  analysis  profession 
emerged  from  the  theory  with  the  conviction  that  the  logical 
methodology  is  equally  applicable  to  all  decision  problems  from 
deciding  on  new  business  ventures  or  enacting  legislation  to 
buying  a  house.  In  fact,  it  is  the  decision  analyst's  initial 
unfamiliarity  with  the  important  relationships  of  the  problem 
that  helps  him  to  maintain  the  vitally  important  professional 
detachment.  [3]  However,  because  of  this  unfamiliarity,  the 
analyst  requires  tools  through  which  the  decision  maker  can 
communicate  clearly  his  perception  of  the  problem  structure. 

A  second  difficulty  in  structuring  is  the  complexity  of  the 
decision  problem.  As  the  number  of  variables  in  the  decision 
problem  increases,  the  structuring  task  becomes  more  difficult  for 
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two  reasons.  First  ths  number  of  possible  relationships  between 
variables  increases  as  (n-1) ! ,  leading  to  a  corresponding  in¬ 
crease  in  the  effort  rwquried  for  the  assessment.  Secondly,  the 
decision  maker  will  not  apprehend  some  of  the  actual  variable 
relationships,  because  prior  to  the  decision  analysis  methodology 
he  had  no  orderly  way  to  address  them.  By  contrast,  in  a  small 
decision  problem,  with  few  variables,  the  decision  maker  is  aware 
of  all  the  relationships  between  variables  and  has  often  spent 
considerable  time  in  analysing  them. 

If  the  decision  problem  is  complex,  then  there  are  likely  to 
be  many  participants  in  structuring  the  problem.  Even  When  there 
is  a  single  decision  maker,  many  experts  are  likely  to  be  con¬ 
sulted  regarding  the  relationships  between  variables,  as  well  as, 
for  probability  assessment.  Moreover,  several  decision  analysts 
may  be  involved.  Figure  1-3  depicts  the  various  communication 
paths  required  for  structuring  a  complex  problem  and  again  sugges. 
the  need  for  a  powerful  communication  tool. 

Review  of  Related  Work  in  Structure  Assessment 

One  promising  communication  tool  is  the  influence  diagram. 

Influence  diagrams  were  developed  at  SRI  International  as  an  auto 

mated  structuring  aid  for  decision  analysis.  [10]  An  influence 

between  two  random  variables,  x  and  y  ,  is  said  to  exist  when 

the  variables  are  probabilistically  dependent,  and  an  arrow  is 

drawn  to  connect  the  two  variables  (Figure  l-4a) . 

Definition  1. 1.  An  influence  between  two 
random  variables  x  and  y  exists  if  for 
some  x  with  nonzero  probability. 


FIGURE  1 


DECISION 


3.  Communication  Paths  Required  For  Structuring  A 
Complex  Decision  Problem 
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{x,y,a  |S)  ■'  k|*,y,S}  fe|S}  ty(S) 


FIGURE  lr4 . 


The  Correspondence  Between  Influence  Diagrams 
And  Assertions  Of  Probablistic  Independence 


(y|x,s)  t  (y|s) 


Using  his  definition,  some  rules  for  the  manipulation  of 
influence  diagrams  can  be  derived  and  are  discussed  in  reference 
[10] .  Each  influence  diagram  corresponds  to  a  particular  expan¬ 
sion  of  a  joint  distribution.  For  example,  the  influence  diagram 
of  l-4b  represents  the  expansion 

k  (x,y,z|s)  -  {*|  x,y,sHy|x,sHx|s)  . 

An.  alternative  expansion,  represented  by  l-4c,  is 

{x,y,z|s}  -  {x|y,z,£}{t|y,5){y|s}  , 

and,  therefore,  l-4c  is  an  allowable  rearrangement  of  the  influences 
of  l-4b.  Comparing  l-4d  with  l-4c  shows  that  the  influence  between 
y  and  z  has  been  removed,  and 

(x,y, zjs)  -  {x|z,y,sHz|s){y|s}  . 

Another  important  property  of  definition  1.1  is  that  it  appears 
to  coincide  with  the  decision  maker's  intuitive  use  of  the  word  in¬ 
fluence.  In  past  applications  of  influence  diagrams  for  complex 
decision  problems  at  SRI  International,  when  a  decision  maker  or 
his  expert  identified  the  existence  of  an  influence  between  vari¬ 
ables  (even  though  it  was  not  mathematically  defined  for  them  as  in 
definition  1.1) ,  the  variables  were  later  determined  to  be  prob¬ 
abilistically  dependent.  Furthermore,  influences  that  were  iden¬ 
tified  as  being  strong  represented,  roughly  speaking,  more  prob¬ 
abilistic  dependence  than  influences  that  were  identified  as  weak. 

Other  researchers  have  demonstrated  similar  structuring  devices, 
such  as  the  interaction  matrix  method.  [2,15]  This  method  indicates 
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tht  axiattnoc  or  non-exiatance  of  interactions  or  influences  in  a 
Matrix  form  rather  than  diagraanatically.  Rows  represent  a  set  of 
variables  ;  and  columns  yj  .  An  influence  between  and 

y^  is  indicated  by  setting  the  ij  element  of  the  matrix  to  one, 
otherwise  it  is  set  to  sero.  When  there  are  sequential  influences, 
x^  influencing  y^  influencing  ,  the  matrices  can  be  multi¬ 
plied  to  show  the  existence  of  influences  between  and  z^ 

(Figure  1-5).  These  interaction  matrices  may  be  quite  large. 

There  are  several  important  shortcomings  in  this  approach. 
First,  the  term  "interaction"  is  not  generally  defined.  It  may 
mean  different  things  to  the  decision  maker  and  analyst,  and  no 
test  is  available  to  compare  usage  of  those  wordB.  Secondly,  a 
ranking  of  interactions  between  xi  and  z^  is  determined  by  the 
number  of  influences  that  exist  between  the  two.  This  ranking  com¬ 
pletely  ignores  the  questions  of  the  degree  and  type  of  the  inter¬ 
action  . 

A  final  criticism  of  the  interaction  matrix  also  applies  to 
the  current  use  of  influence  diagrams.  Both  require  judgment  as 
to  the  relative  importance  of  influences  or  interactions.  The 
analyst  laments,  "Everything  is  affected  to  some  degree  by  every¬ 
thing  else,"  and  a  limitation  exists  on  the  number  of  influences 
that  can  be  analyzed.  Since  interaction  is  not  defined  in  its  use 
with  interaction  matrices,  we  see  little  chance  that  anyone's 
judgment  regarding  the  relative  importance  of  interactions  is 
meaningful.  For  influence  diagrams,  a  rough  notion  of  more  or  less 
dependence  exists,  but  it  is  not  precise.  Figure  1-6  shows  an 
example  of  two  possible  relationships  of  x  and  y  .  In  the  first 
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f*—  a  change  in  mean 


FIGURE  1-6.  An  Example  Demonstrating  Ambiguity  About  The 
Relative  Importance  Of  Two  Influences 


example  the  expectation  of  the  distribution  on  y  is  unchanged 
given  the  value  of  x  .  However,  the  variance  of  that  distribu¬ 
tion  changes  depending  on  the  value  of  x  .  In  the  second  example, 
the  expectation  changes  depending  on  the  value  of  x  ,  but  the 
variance  does  not.  Which  of  the  two  cases  represents  the  most 
important  influence? 

1.3  .Summary  and  Contributions  of  this  Research 

The  example  of  Figure  1-6  suggests  that  definition  1.1  is  not 
a  complete  description  of  influence.  While  it  does  define  the 
existence  of  influence,  it  does  not  describe  the  influence  itself. 
Most  of  Chapter  2  is  devoted  to  the  development  of  a  mathematically 
precise,  general  description  of  influence  that  is  consistent  with 
the  condition  of  existence  given  by  definition  1.1.  This  descrip¬ 
tion  is  applicable  to  both  continuous  and  discrete  influencing 
and  influenced  random  variables.  In  the  final  section  of  Chapter 
2,  we  introduce  an  approximate  description  of  influence  to  reduce 
the  informational  requirement. 

Section  2  of  Chapter  3  shows  that  the  influence  of  any  vari¬ 
able  on  the  profit  lottery  can  be  determined  by  means  of  an  in¬ 
fluence  calculus.  The  notation  for  the  influence  of  one  variable 
on  another  is  carefully  selected  so  that  the  equations  for  the 
influence  calculus  can  be  obtained  by  inspection  of  the  influence 
diagram.  The  implications  for  the  decision  model  of  the  various 
degrees  and  types  of  influence  are  conceptualized  in  the  influence- 
consequence  matrix,  which  is  presented  in  Section  3.4.  We  show  how 
the  influence  matrix  can  be  used  to  estimate  the  differences  between 


16 


th*  prof it  lottery  from  the  decision  model  and  the  decision  maker's 
authentic  profit  lottery.  Probably  the  most  important  philosophi¬ 
cal  result  of  Chapter  3  is  that  the  selection  of  variables  to  com¬ 
pose  the  decision  model  should  depend  on  the  decision  maker's  risk 
attitutde.  Several  examples  are  given. 

Chapter  4  compares  methods  for  approximating  the  profit 
lottery  from  information  about  the  distribution  of  the  profit 
lottery  conditioned  on  a  state  variable  and  the  marginal  distri¬ 
bution  on  the  state  variable.  First,  we  show  that  it  is  the 
functional  form  of  the  conditional  surface  as  a  function  of  the 
state  variable  that  determines  the  amount  of  information  required 
to  compute  the  profit  lottery  exactly.  We  also  show  that  the 
difference  between  the  quadratic  approximation,  which  is  the  basis 
for  the  practical  application  of  the  influence  concept,  and  con¬ 
ventional  discretization  is  the  assumption  about  the  shape  of  the 
conditional  surface.  The  quadratic  method  assumes  this  surface  is 
quadratic  in  the  conditioning  variable,  and  discretization  assumes 
it  is  piecewise  linear.  Since  the  quadratic  method  is  shown  to  be 
as  sound  theoretically  as  discretization  and  to  be  comparable  in 
both  ease  of  assessment  and  accuracy,  it  should  be  considered  as 
an  alternate  method  for  the  solution  of  decision  problems  directly 
from  the  influence  diagram. 

After  summarizing  the  results  of  the  previous  chapters.  Chapter 
5  proposes  extending  the  influence  calculus  to  include  decision 
variables  in  order  that  the  solution  to  decision  problems  can  be 
directly  obtained  from  the  influence  diagram.  We  3how  that  the 
influence  calculus  and  influence  notation  extend  in  a  natural  way 
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to  accommodate  decision  variables.  Furthermore,  the  influence 
vector  describing  the  influence  of  the  decision  variable  on  the 
profit  lottery  may  be  closely  related  to  the  solution  of  the 
decision  problem.  These  preliminary  results  lead  us  to  encourage 
further  research  in  the  application  of  the  influence  concept  to 
decision  problems. 
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CHAPTER  2 


Toward  a  Theory  of  Influence 

2*1  Introduction 

Influence  diagrams  are  an  attractive  neans  for  assessing 
the  decision  Maker's  structure  and  communicating  it.  However , 
since  only  the  existence  of  an  influence  has  so  far  been 

defined,  the  diagrams  are  only  useful  for  specifying  the 

✓ 

existence  of  relationships  between  variables.  That  is,  the 
decision  maker  can  indicate  using  influence  diagrams  which  state 
variables  are  members  of  the  sets  sj,  s2,  ....  fN  of  the 
equation  (1.1.4).  The  influence  diagram  does  not  indicate  the 
nature  of  the  conditional  relationships  among  the  state 
variables,  { v |  Si,d,S}  or  {8n-.i|Sn,  s)  ,  and  there  is  no 
theoretical  basis  by  which  to  reduce  the  potentially  large  sets 
8*  of  important  state  variables  (expression  1.1.5). 

The  purpose  of  this  chapter  is  to  present  a  definition  of 
influence  that  will  extend  the  usefulness  of  influence  diagrams. 
To  that  end,  influence  should  be  defined  so  that  structuring  a 
decision  model  using  the  variables  with  greatest  influence  will 
result  in  a  theoretically  sound  decision  model  and  lead  to  a 
solution  of  the  decision  problem.  We  also  want  a  definition 
that  is  consistent  with  the  intuition  of  both  the  analyst  and  the 
decision  maker  ,  Finally  practical  application  demands  that 


tha  dtgree  of  influence  bo  either  eesily  asseeeable  or  routinely 
aaaeaaed  as  part  of  the  decision  analysis  procedure. 

Some  possible  definitions  of  influence  do  not  result  in  a 

useful  structuring  methodology  for  decision  analysis,  because  they 

do  not  focus  on  the  authenticity  of  the  profit  lottery.  For  example, 

mutual  information  is  a  concept  from  information  theory  that  is 

used  to  measure  the  dependence  of  two  random  variables.  The  mutual 

information  for  variables  x  and  y  denoted  by  I  is  given  by 

*  9  y 

Vy*  f  f  {x,y|s>  109  dlt  dy  • 

Constructing  a  decision  model  on  the  basis  of  a  variable's  mutual 
information  with  other  model  variables  does  not  result  in  a  satis¬ 
factory  decision  model.  (13]  The  reason  is  that  mutual  information 
indicates  the  importance  of  a  variable  to  the  system  model  rather 
than  its  importance  to  the  profit  lottery.  This  conclusion  is 
congruous  with  Tani's  claim  that  the  purpose  of  modeling  in  deci¬ 
sion  analysis  is  the  attainment  of  the  decision  maker's  authentic 
profit  lottery. 

2.2  Continuous  Random  Variables  Influencing  Either  Continuous 

Random  Variables  or  Discrete  Random  Variables 

Since  this  section  is  rather  lengthy  and  includes  several 
theorems,  lemmas,  and  their  proofs,  Table  2-1  outlines  the  essen¬ 
tial  argument  presented  in  this  section.  Our  interest  is  mainly 
in  the  matrix  *  However»  to  explain  the  meaning  of  the 

elements  of  this  matrix  and  to  introduce  the  notation  for  deriva¬ 
tives  of  moments  of  probability  distributions,  it  is  necessary  to 
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Tabl«  2-1 


Survey  of  tha  Argument  Praaantad  In  Saction  2.2 

Theorem  2.1  (weak) t  A  particular  matrix  M  ■  I  if  and 
only  if  tha  moments  of  {y|$}  are  independent  of  {x|S} . 

La— a  2. 2 1  Suppose  {y|$}  has  an  analytic  character¬ 
istic  function.  Then,  if  its  aoaents  are  independent 
of  {x|S}*  the  distribution  {y|S}  is  independent  of  {x|S}. 

Theorem  2.4  (strong):  Suppose  {y|S}  has  an  analytic 
characteristic  function.  Then,  M  »  0  if  and  only  if 
{y I S)  is  independent  of  (x|S). 

Lemma  2.5:  The  matrix  M  *  0  if  and  only  if  another 

"*trlx  JflHit '  •• 

Theorem  2.6:  Suppose  {y I s)  has  an  analytic  charac¬ 
teristic  function.  Then  ■  B  if  and  only  if 

{y I S)  is  independent  of  {x|$}. 

Corollary  2.7:  Suppose  { y I S >  has  an  analytic  charac¬ 
teristic  function.  Then,  the  condition  ^ ¥  0 

d{x! S} 

is  equivalent  to  probabilistic  dependence  and  the 
existence  of  an  influence  according  to  Definition  1.1. 
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first  consider  the  matrix  M  ,  which  will  presently  be  defined. 

We  also  use  the  matrix  M  to  explain  the  necessity  of  probability 
densities  that  have  analytic  characteristic  functions. 

The  main  results  of  this  section  are  theorem  2.6  and  corollary 
2.7.  They  show  the  close  relationship  between  the  influence  matrix 
and  our  previous  use  of  influence  and  justify  our  interpretation 
of  the  influence  matrix  as  a  description  of  the  influence. 

To  begin  our  development  of  a  description  of  an  influence,  we 
consider  a  limiting  case  of  the  influence  between  two  variables: 
no  influence.  In  this  case,  the  authenticity  of  the  profit  lottery 
or  ny  other  influenced  state  variable  is  unaffected  by  the  authen¬ 
ticity  of  the  influencing  variable.  What  is  the  mathematical  char¬ 
acterization  of  the  nonexistence  of  an  influence? 

Let  the  influenced  variable  y  ,  have  a  probability  density 
function  or  probability  mass  function  {y|s}  .  Our  development  in 
the  -i ..  linder  of  the  chapter  will  not  depend  on  whether  y  is  con- 
tinuov  or  discrete.  If  y  is  the  value  function,  then  {y|s} 
is  called  the  profit  lottery,  and  the  profit  lottery  may  be  con¬ 
ditioned  n  a  setting  of  the  decision  variable.  However,  the 
develop;  t  that  follows  can  easily  be  modified  to  include  the 

conditioning  by  a  decision.  Let  x  be  the  influencing  state 
variable  with  probability  density  distribution  (x|S)  .  Again, 
this  state  variable  could  be  conditioned  by  a  setting  of  the  deci¬ 
sion  variable.  We  begin  with  the  expansion  equation, 

(2.2.1),  <ym|S>  =  f  <ym|x,S>  (x|S}dx  . 

•'x 

m  1,2,... 
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Expanding  <y  Jx,5>  in  *  Taylor's  aeries  about  <x|s>  and  in¬ 
tegrating  ,  we  obtain 

(2, 2. 2)  <y“|S>  -  <yn|x  -  x,S>  ♦ 


?  ±  dn<ym]xrg> 

n-2  n*  dxn 


<  (x-  x)n|5> 


1#2,  > • • 


th 


Equation  (2.2.2)  ahowa  the  dependence  of  the  m  moment  of  the  prof 
it  lottery  on  the  central  sonants  of  the  marginal  distribution  of 
the  state  variable  (xjs)  ,  and  on  the  conditional  distribution 
of  y  given  x  ,  {y|x,S}  .  This  equation  includes  ordinary 
moments  of  a  distribution. 


<x 


n|s>  - J  xn{x|5)dx 


and  central  moments. 


(x-x)n|s>  »  j  (x  -  x)n{x|s)dx  . 


n 


These  two  equations  are  related,  since  (x  -  x)  may  be  expanded 
and  then  the  expectation  operator  applied,  e.g., 


<(x-x)2|S>  »  <x2  -  2xx  +  x2|s> 


2  2 

®  <x  |s>  -  <x|s> 


Sometimes  we  denote  expectation  with  a  bar  over  the  variable,  as 
for  example 

<x|S>  =  x  . 

The  m^  moment  of  y  is  a  function  of  eve  *y  moment  of  the 
state  variable  distribution  according  to  equation  (2.2.2), 


(2.2.3) 


<ym\S>  ■  f  (<x|S  >,<  (x-x)  2  |S  >,<  (x-x)  3  |s  >, . . . ) 


The  functional  fora  of  f(*)  is  determined  by  the  functional 
fora  of  the  conditional  distributions  <ym|x,S>.  If  the  mth 
moment  of  the  profit  lottery  ia  unaffected  by  a  small  perturbation 
in  the  n1^  central  moment  (n  -  2,3,...)  of  the  state  variable  dis¬ 
tribution,  then  it  must  be  true  that 


2<£l£> 

3< (x-x)n  |$> 


x,< (x-x) 


3f 

8< (x-x)n|s> 


0 


n  *  2,3,... 


Differentiating  (2.2.2)  gives 


(2.2.4) 


3<ya>l5>  m  1  dn<ym|x,S> 
a<(x-x)n|S>-  dxn 


0 


n 


2,3 


i  •  •  t 


Similarly, 


_  d<ym|x,S> 

,  T  1  dn+1<ym|x,S> 

dx 

-  n-2"1  d?*1 

X 

< (x-x) n |s> 


■  0  . 

Both  (2.2.4)  and  (2.2.5)  are  functions  of  the  expectation  of  the 
marginal  distribution  of  x  and  both  are  evaluated  at  the  nominal 
value  <x|s>  .  Equation  (2.2.4)  shows  that  the  rate  of  change  of 
the  moment  of  the  profit  lottery  is  independent  of  the  magni- 
tude  of  the  n  central  moment  of  the  state  variable  < (x-x)  |s>  , 

n  »  2,3,...  However,  from  (2.2.5)  the  rate  of  change  of  the  m*"*1 
moment  with  respect  to  <x|S>  may  depend  on  the  magnitude  of  every 
moment  of  the  state  variable  distribution. 

Now,  suppose  that  the  marginal  distribution  of  the  state  vari¬ 
able  x-  is  changed  in  such  a  way  as  to  perturb  its  mean  and  central 
moments  slightly.  If  the  profit  lottery  is  unaffected  by  the  change, 
then  equations  (2.2.4)  and  (2.2.5)  must  hold  for 
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In  matrix  font  this  condition  is  N  *  0  where 


(2*2.6) 


m  a<y|s> 

a<x  5> 

• 

i 

e 

e 

’X 

e 

3<y|5> 

a< (x-xf 

• 

\s> 

• 

• 

a<y"  s> 
I<x|5> 


«• 

x 


3<ym|S>  _ 

3<  (x-x^  |,S> 


x 


The  authenticity  of  the  profit  lottery  can  only  be  affected 
by  the  authenticity  of  a  state  variable  distribution  when  the 
profit  lottery  is  altered  as  a  result  of  changes  in  the  state 
variable  distribution.  Hence,  the  development  of  the  last  few 
pages  suggests  the  following: 

Theorem  2 , 1  (Weak  Form) .  The  moments  (if  they  exist)  of 
the  marginal  distribution  {y|s}  of  a  variable  y  are 
independent  of  the  marginal  density  distribution  {x|5} 
of  a  variable  x  if  and  only  if  H  *  0  ,  where  M  is 
defined  by  equation  (2.2.6). 


Proof :  First,  assume  H  ■  0  .  Then,  by  (2.2.6), 


(2.2.7) 


1  dn<ymlx,5> 


n: 


dx' 


0  for  all  m  and  n  >  1  . 


Hence',  <yfl'|x,S>  is  not  a  function  of  x  ,  <ym|x,S>  =  <yw|s>  , 
and  the  moments  of  {y|S}  are  independent  of  (x|s)  .  Next, 
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_ i 


assume  the  momenta  of  (y|s)  are  independent  of  {x|s}  .  Let 
{x  |£  }  be  an  arbitrary  probability  denaity  function  on  x  . 

By  equation  (2.2,2),  wo  have 


(2.2.8)  <y“js>  ■  <yw|x  •  x,s>  ♦  J 

_  _  lie  .  n 


n-2 


dx 


<  (x-x)n|s> 


Suppose  {x|  5 }  is  another  probability  density  distribution 

that  differs  from  (x|s)  only  in  its  n^  central  moment.  Then 

since  the  moments  of  (y|s)  are  unaffected  by  {x|s)  , 

n_mi 


(2.2.9)  <y“|s>  -  <y“|x  -  x',S>  ♦  I  X 


n»2 


dx* 


<  (x-x)n|s>* 


.  I 


Equating  (2.2.8)  and  (2.2.9)  and  noting  x  ■  x  yields, 
i  dn<vro|  x,g>f  -  '  jn'  "mi 


n: 


dx 


n 


<(X-X)n|,>-  -<'j,lx,S> 


<  (x-x) n| S> 


which  is  only  true  if 


_1_  dn<yrelx,5> 


n! 


dx 


n 


0  . 


If  the  two  distributions  {x|s}  and  (iijs)  differ  only  in 
their  means,  equating  (2.1.8)  and  (2.1.9)  gives 

(2.2.10)  <ym|x  -  x,S>  -  <ym|x  -  T:',S>  . 

Since  {x|s}  and  therefore  x  are  arbitrary,  equation  (2.1.10) 
requires  that. 


a<yml*.s> 


dx 


0 

x 


Theorem  2.1  as  presented  above  fa'ils  short  of  claiming  that 
distribution  (yjs)  is  independent  of  {x|s}  .  That  claim 


requires  that  independence  of  all  of  the  momenta  implies  in¬ 
dependence  of  the  distribution  itself.  Under  certain  conditions 
on  (yjs)  ,  one  can  show  that  this  independence  implication 
holds,  and  these  conditions  lead  to  a  stronger  version  of  Theorem 
2.1. 

Lemma  2.2t  Suppose  (y|s)  has  a  characteristic  function 
f (is)  that  is  analytic  in  a  neighborhood  of  s  ■  0  ,  where 
s  is  a  complex  variable.  If 

<yn|S>  ■  <yn|x,S>  ,  n  -  1,2,.,. 

then 

{y|s}  ■  (y|x,S) 

Our  proof  depends  on  a  theorem  proven  by  Neuts  [12] 
and  restated  here. 

Theorem  2.3  [Neuts].  If  the  distribution  (y|s)  has  a 
characteristic  function  fy(is)  that  is  analytic  in  a 
neighborhood  of  s  ■  0  ,  then 

(2.2.11)  f  (is)  -  l  5YkJxfg>(is)k 

y  k*0  K * 

Proof  of  Lemma  2.2: 

Using  the  hypothesis  of  this  lemma  with  equation  (2.2.11) 
we  obtain, 

(2.2.12)  £  (is)  -  £  -<y  l^S>(is)k 

y  k»0  K* 

The  right-hand  side  of  (2.2.12)  is  the  Maclauren's  series  for 
the  characteristic  function  of  (y|x,5)  ,  fy|X(*)-  Hence 

fytis)  -  ty|x(is) 
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Sine*  the  characteristic  function  has  a  unique  inverse, 

(y|s)  ■  (y|x,S)  . 

While  our  leans  is  concerned  only  with  independence.  Theorem  2.3 
addresses  the  broader  issue  of  when  a  distribution  is  determined 
by  its  moments.  A  distribution  is  not  generally  determined  by 
its  moments,  and  there  are  several  examples  that  demonstrate 
the  indeterminancy^  [11]  *  3^  iP  these  same  examples  Wglr  prohibit 
us  from  claiming  in  Theorem  2.1  that  the  distribution  (y|s)  is 
independent  when  N  ■  0  .  However,  with  the  aid  of  Lemma  2.2, 
we  introduce  another  theorem. 

Theorem  2.4.  (strong  form).  Suppose  {y|s}  has  a 
characteristic  function  f(is)  that  is  analytic  in  a 
neighborhood  of  s  ■  0  .  The  marginal  distribution 
{y|S}  on  a  variable  y  is  independent  of  the  marginal 
density  distribution  {x|s}  on  a  variable  x  if  and 
only  if  M  ■  0  , 

Proof: 

First  assume  M  *  0  .  By  Theorem  2.1  the  moments  of  (y|s} 
are  independent  of  (x]S)  .  By  Lemma  2.2  (y|s)  *  (y|x,S)  . 

Next  assume  {y|s)  is  independent  of  (x|s)  .  Then  the  moments 
of  {y|S>  are  independent  of  {x|s}  .  According  to  Theorem  2.1, 
M  ■  0  . 

We  defer  discussion  of  the  importance  of  the  matrix  M  and  its 
connection  with  influence  since  there  is  a  more  useful  form  of 
Theorem  2.4.  By  writing 
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(2.2.13)  <(y-y)m|s>  -  <ym\s>  +  ...  +  (-i)r <ym”r \s><y\s>T 

+  ...  +  <y|s>m  , 


and  differentiating  we  obtain. 


3<(y-?)n|s> 


3<  (x-5t)n|  S> 


*<ym\S> 

3<(x-x)n|s> 


m  ■  2,3, .. . 
o  <  r  <  m 

+  ... 


(2.2.14) 


+  r<yrn“r|s> 


<y|S> 


r-1  3<y \S> 


3< (x-x) n  S> 


)+...+  nxyls^-^^yjf 

_  l  3< (x-x) n| 


S> 


m  **-  2,3,... 
n  -  2,3, .. . 
o  <  r  <  m 

Each  of  these  terns  can  be  evaluated  with  the  help  of  (2.2.4) 
and  (2.2.5). 

Now  consider  a  matrix  denoted  by  and  defined  by 

S) 


<2-2l5>  M  ■ 


3<y I  £>1  3< (y~y)m|g  > 


3<x|  s>  I  jf 


3<y )£> _ 

3<  (x~x)n|5> 


3<x |S> 


...  3<(y~y)mls> 

3<(x-x)n|5> 
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Lemma  2.5.  The  matrix  M  -  0  if  and  only  if  the  matrix 
d{x|~fl  "  0  '  where  M  is  defined  by  equation  (2.2.6)  and 
d{y|5)  ...  / n  ie\ 


by  (2.2.15)  . 


Proof:  for  convenience  of  notation  let  N  =  . 

Suppose  M  »  0  ,  then  we  must  show  that  =  0  for 


all  n,m  .  By  equation  (2.2.14) 


(2.2.16) 


♦  -  ♦  <*1>r  (r)i? 


-r  d<ym*"r  I  S> 


d<* [S> 


_i_  „m-r_  -r-1  d<y  S>  (  .  .  _-m-l  d<y  s> 

+  y  ry  aos^+-**+my  aors> 


where  d<»js>  represents  d<(x-x)n|s>  for  n  *  2,3,... 
Since  the  mth  column  of  N  ,  g>  is  a  linear 


u^iivv  w  vs  a  *******  v/a.  n  f  ^ ^  #  xo  u  x j.iicai 

combination  of  the  columns  of  M  according  to  (2.2.16), 
M  »  ft  implies  N  *  p  . 

Now,  suppose  N  »  0  .  We  show  by  induction  that  M  -  0  , 
Comparing  equations  (2.2.6)  and  (2.2.15), 


By  hypothesis, 


(2.2.17) 


M  ,  =  N  . 
a  /  x  n  f  x 

all  i 

M  ,  =  N  . 
n ,  j  n ,  j 

j  <  m 

i# 

M  .  =  0 

j  <  m 

Since  N  „  ■  0  for  all  n  ,  equation  (2.2.16)  becomes 
n ,  m 


.mi 


(2.2.18) 


d<y  S>  , 
d<* 


•••  +  <-^>r  (") |?r  ^ 


^  ..n- r  _-r-l  d<y  S>  .  .  _-m-l  d<y 

+  y  ry  5 <*~s>  +  •••  +  my  d<T 


5> 


5> 


However,  by  (2.2.17) 


0 


j  <  m  , 


and  (2.2.18)  reduces  to 


d<ym  S> 
d<* 1 S> 


Consequently 

Mn,j  “  0  i  i  “  • 

By  induction,  N  =  0  implies  M  =  0  . 

Using  Lemma  2.5  with  Theorem  2.4,  we  immediately  obtain: 


Theorem  2.6.  Suppose  {y|s}  has  a  characteristic 
function  f(is)  that  is  analytic  in  a  neighborhood 
of  s  =  0  .  The  marginal  distribution  {y|s}  of  a 
variable  y  is  independent  of  the  marginal  density 
distribution  (x|s)  of  a  variable  x  ,  if  and  only 


if 


d{y 


dl 


-  0  ,  where  is  defined  by  (2.2.15) 


When  an  influence  exists  between  two  variables,  a  matrix 


of  the  form  of 


s) 

ciTx 

s } 

characterizes  the  influence.  It  is  a 


particular  representation  of  how  the  authenticity  of  one  dis¬ 
tribution  depends  on  the  authenticity  of  another  distribution. 


n,m  aleroent  (n  >  1,  m  >  1)  is  the  effect  on  the  m 
central  moment  of  the  influenced  distribution  of  a  unit  change 
in  the  nth  central  moment  of  the  influencing  distribution 
(Equation  2.2. 14) . 

Since  the  matrix  is  null  when  no  influence  exists  and 

indicates  the  type  of  dependency  when  an  influence  does  exist, 

we  call  that  matrix  the  "influence  matrix"  or  simply  the 

"influence"  of  (x|s)  on  Cy ! 5}  .  We  denote  the  influence 

d(y  5} 

matrix  describing  the  influence  by  * 

Many  distributions  of  practical  interest,  such  as  the 
uniform,  exponential  and  normal,  do  have  analytic  character¬ 
istic  functions.  However,  it  is  not  really  necessary  that  the 
marginal  distribution  {yjs}  have  an  analytic  characteristic 
function.  By  using  Lemma  2.5  with  Theorem  2.1,  a  weak  version 
of  2.6  can  be  obtained  that  gives  ■  0  if  and  only  if 

the  moments  of  {y|s}  are  independent  of  (xjs)  .  In  all  the 
work  that  follows  we  are  only  concerned  with  the  moments  of  the 
influenced  distribution.  Furthermore,  we  use  the  influence 
matrix  to  describe  influences  when  they  are  known  to  exist,  not 
to  discern  their  existence. 

One  implication  of  the  matrix  definition  of  influence  is 
that  an  influence  diagram  should  be  drawn  as  in  2-la  rather  than 
2-lb.  An  influence  is  the  impact  of  one  marginal  distribution 
on  another.  Looking  back  to  definition  1.1,  it  is  clear  that 
the  existence  of  an  influence  means  that  the  distribution  is 
influenced  rather  than  the  variable.  However,  definition  1.1 
is  ambiguous  about  what  the  influencing  factor  is. 


While  the  difference  between  2-la  and  2-lb  is  not  essen¬ 
tial,  it  distinguishes  influence  diagrams  from  other  structuring 

,  ,  I 

devices.  By  emphasizing  that  an  influence  relates  two  prob-  I  . r. 
ability  distributions,  the  users  of  the  diagrams  are  reminded  > 
that  the  relationship  may  be  probabilistic  as  well  as  deter¬ 
ministic  and  noncausal  as  well  as  causal. 


Influence  Matrix  Notation  is  Conducive  to 
An  Influence  Calculus 


The  notation  for  the  influence  matrix 


S} 

dtx 

s) 

was  selected 


because  it  leads  to  a  framework  for  conceptualizing  and  analyzing 
the  influences  represented  by  a  complex  influence  diagram.  In 
particular,  it  supports  a  calculus  of  influences. 

Suppose  three  variables  x,  y,  and  z  are  related  as 
shown  by  the  influence  diagram  below: 


FIGURE  2-2.  An  Influence  Diagram  Suggesting 
An  Influence  Calculus 


Given  the  influence  of  {x|s}  on  (y|s)  , 


matrix 


by 


d{z 

5} 

dty 

s\ 

d(y 

S ) 

dlx 

s) 

■jj-  ,  and  the  influence  of  {y|s} 
■^j,  how  can  the  influence  of  {x|s} 


puted?  Recalling  Equation  (2.2.3) 


as  described 
on  {z|,s} 
on  (z[s) 


by  the 
described 
be  com- 
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9  •  •  •  9 


) 


(2.2.3)  <ym|S>  =  f (<x|S>  ,  <(x-x)2|s> 

•very  moment  of  {y|S}  depends  on  every  central  moment  of 
{x|si  and  its  expectation.  By  equation  (2.2.13) ,  every  central 
moment  of  (y|S)  must  also  depend  on  every  central  moment  and 
the  expectation  of  (x|5)  , 

\2.2.19)  <(y-ym|5>  -  fm (<x |  s>  ,<(x-x)2|s>,  ...) 

Similarly, 

(2.2.20)  <z|s>  -  g1(<y|5>  ,<(y-y)2|s>,  ...) 

<  (z-z)r)s>  ■  gr(<y|s>  ,  <y-y)2|s>  ...) 

By  the  chain  rule  of  differential  calculus, 

(2  2  21)  3<  ( z*~z ) r  1  S>  m  3<  (z-z)r \S>  3<y[s>  (  3<  (z-z)rls>  9<  (y-y)  2\s> 

3<  (x-x) n 1 5>  3<y|s>  3<  (x-x) n | S>  3<  (y-y) 2  |5>  3<  (x-x) "j S> 


Since  (2.2.21)  is  the  matrix  product  of  the  r 
th 


th 


column  of 


and  the  n 

(2.2.22) 


row  of 


S } 

dlx 

si 

we  can  write 


d{z 

S) 

dlx 

si 

d(y 

art 


s) 

sT 


d(z 1 S) 
d(y 1 5} 


d(z 

Si 

dly 

si 

which  is  analogous  to  the  chain  rule  of  differential  calculus. 
We  pursue  the  calculus  of  influences  and  its  form  for  complex 
influence  diagrams  more  thoroughly  in  a  later  section. 


2 . 3  Discrete  Random  Variables  Influencing  Either 
Continuous  or  Discrete  Random  Variables 

There  are  many  discrete  events,  such  as  whether  or  not  it 
rains'  tomorrow  and  the  number  of  senators  voting  for  a  particular 
treaty.  Sometimes  the  probability  mass  function  for  these  discrete 
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•vents  influences  s  probability  density  function  of  a  continuous 
random  variable  or  a  probability  mass  function.  To  extend  the 
influence  matrix  concept  to  include  this  situation,  let  {x|s} 
be  the  influencing  probability  mass  function,  and  let  {y|s}  be 
either  a  probability  mass  function  or  a  probability  density  func¬ 
tion.  The  quantity  x  takes  on  the  values  xk  for  1  £  k  £  K 
with  probability  Px(xk)  •  0ur  approach  is  to  fit  a  continuous 
curve  through  the  points  <ym|xk,S>  at  each  point  xk  .  Then, 
these  curves  can  be  used  to  derive  equations  for  <ym|s>  in  the 
same  way  as  in  the  previous  section.  Let  the  function  fm(x) 
satisfy  the  following  conditions: 

(2.3.1)  fl0(xk)  "  <ymlxk»5>  k-  1,2, ...,K 

The  function  fra(x)  is  not  unique,  and  such  a  function  always 
exists.  ??or  example,  polynomials  of  degree  greater  than  K  -  1 
can  be  found  which  satisfy  (2.3.1).  Writing  the  Taylor 'r  series 
for  fm(x)  about  x  =»  x  gives 

(2.3.2)  /  (x)  =  fm(x)  +  S  ~  fraU)  (x-x)n  . 

n=l  n* 

where  rm  _  dnfm(x) 

n "  ' 

This  expression  leads  to, 

<vn' •■>  T  <ym|xk,5>  Px(xk) 

K 

(2.3.3)  -  I  [fm(x)  +  1  K  f™(x)(x  -x)n]  P  (x.  ) 

k  n=l  n*  n  k  x  k 

*''*(x)+  S  k  f“(x)  <  (x-x)n|s> 
n»2  n-  n 
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Equation  (2.3.3)  allows  us  to  define  the  elements  of  the 
influence  matrix  for  a  discrete  influencing  variable  with  equa¬ 
tions  similar  to  those  we  use  when  the  influencing  variable  is 
continuous.  In  particular#  we  can  write 

(2.3.4)  *■(!) 

3<(x-x)aj S>  n' 


(2.3.5) 


3<ym  S> 

TOT'S* 


*?<*>  +  I,  5!  Cl<x>  *  <x-*>nls> 

n»2 


(2.3.6) 


3< (y-y)m|5> 


a<ym|s> 


3<(x-x)n|  S>  -  3<(x-x)n|5>  - 


+  ... 


6)  +  ;-i)r  !•)  f<yl*>r 

Vm  r7  (  3<  (x-x)  r|S>  - 

<y|5>r-l  ^yl^>  I  )+...♦  m<y|5>m-1  W&l  - 
3<  (x-x)Ts>  |  )  3<(x-x)n 


f?-  +  r<ym”"r|s> 

\s>  - 


U>  _ 


ro  =  2  ,  3 1  •  • . 


n  =  2 , 3 , . . . 


Equations  (2.3.4)  and  (2.3.5)  differ  from  (2.2.4)  and  (2.2.5) 
only  in  the  replacement  of  the  conditional  moment  <ym|x,S>  by 
the  function  fm(x).  Equation  (2.3.6)  is  identical  to  (2.2.14). 

The  similarity  of  these  sets  of  equations  means  that  the 
theorems  and  corollaries  presented  earlier  for  the  case  of  a 
continuous  influencing  variable  are  applicable  to  the  case  of 
the  discrete  influencing  variable.  No  essential  changes  are 
required  in  the  proofs.  Hence#  the  influence  matrix 
with  its  elements  appropriately  defined,  can  describe  the 
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influsncs  of  one  random  variable  on  another,  whether  the 
variable*  are  continuous  or  discrete. 


2.4  Approximation  to  Obtain  Finite  Influence  Matrices 

One  difficulty  with  the  influence  matrices  presented  so 
far  is  that  they  require  specifying  an  infinite  number  of 
elements.  To  obtain  the  information  necessary  to  compute  the 
elements,  the  decision  analyst  would  need  to  assess  the  marginal 
distribution  on  the  influencing  state  variable  and  the  entire 
conditional  surface.  Table  2-2  shows  that  all  of  the  moments 
of  the  state  variable  distribution  are  required.  Obtaining 
all  of  the  derivatives  of  the  conditional  surface  practically 
necessitates  assessing  the  entire  conditional  surface.  The 
moments  or  probability  densities  of  the  influenced  variable 
are  also  required,  but  in  Chapter  4  we  show  how  to  obtain 
these  moments  from  other  information. 

Since  our  intention  is  to  use  the  influence  matrix  to 
structure  the  decision  problem,  an  approximation  to  the  in¬ 
fluence  matrix  may  be  sufficient  and  desirable.  The  analysis 
of  the  influence  matrices  is  likely  to  show  that  some  state 
variables  are  unimportant  to  the  problem.  If  a  variable  is 
determined  to  be  unimportant,  then  most  or  all  of  the  informa¬ 
tion  obtained  about  the  unimportant  variable  will  be  irrelevant 
to  the  remainder  of  the  decision  analysis.  Hence,  it  is  im¬ 
portant  to  determine  the  structure  of  the  decision  problem  i 

with  as  little  information  as  possible. 

The  numbers  of  nonzero  elements  of  the  influence  matrix 
can  be  reduced  to  four  by  making  the  following  approximations: 
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Table  2-2 

Information  raquired  to  apacify  the  Complete  Influence 
Matrix. 

e  All  derivatives  of  every  conditional  moment, 

ro  *  1,2, .. . 

n  ■  1 , 2 ,  •  •  • 

•  All  moments  of  the  state  variable  distribution. 
<x|S>  ,  <(x-x)n|S>  n  *  2,3,... 
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1) 


*  The  profit  lottery  can  ba  adequately  daacribad  by 
ita  naan  and  varianca. 

2) .  Evary  conditional  axpactation  and  second  moment 
is  quadratic  in  the  conditioning  variable. 

The  severity  of  the  first  approximation  depends  on  the 
intended  use  of  the  profit  lottery.  With  only  the  mean  and 
variance*  one  can  adequately  represent  the  mean  and  the  dis¬ 
persion  about  the  mean.  In  many  instances  the  certain  equiva¬ 
lent  can  be  determined  to  within  a  few  percent  using  the  approxi¬ 
mation*  [14] 

(2.4.1)  ~<y|s>  ■  <yj$>  -  j  yv<y|s>  . 

This  equation  states  that  the  amount  the  decision  maker 
would  accept  for  certain,  rather  than  face  the  uncertainty  of 
the  profit  lottery,  is  approximately  equal  to  the  expectation 
of  the  profit  lottery  less  an  amount  proportional  to  the  variance 
of  the  lottery.  The  constant  of  proportionality  y  is  a  measure 
of  the  decision  maker's  attitude  toward  risk,  and  it  is  called 
his  risk  attitude.  Questions  about  the  cumulative  probability, 
which  are  sometimes  important*  however,  can  only  be  crudely 
answered  using  these  approximations. 

By  the  first  approximation,  the  influence  matrix  of  Figure 
2-3a  simplifies  to  a  matrix  with  only  two  nonzero  columns  (Figure 
2-3b) .  Approximation  2  is  not  an  approximation  of  a  probability 
distribution  by  a  quadratic  function.  Rather,  it  is  the  approxi¬ 
mation  of  two  functions  of  the  conditioning  variable  by  two 
different  quadratic  functions* 
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3.  The  Effects  Of  Approximations  On  The  Influence 
Matrix 


(2.4.2) 


<yn|x,£>  •  k J  +  kj(x-x)  ♦  k*(x-x)2  m  »  1,2 

Using  only  this  approximation,  ths  influsncs  matrix  of  2-3a 
siaplifiss  to  tha  matrix  with  aero  slamsnts  as  shown  in  Figure 
2-3c.  Applying  both  approximations  givss  tha  four  element  matrix 
of  Figura  2-4. 

Approximating  tha  influanoa  matrix  with  a  2x2  matrix 
considarably  raducas  tha  informational  requirement.  The  approxi¬ 
mate  matrix  only  requires  four  derivatives  that  describe  the 
conditional  surface,  and  the  mean  of  the  state  variable  distribu¬ 
tion. 
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i$ds> 

dfc|s) 


d<yjs> 

d<xjs>  - 


d  <ylg>l 


d  <x\s>\-  I 


d  <y|S> 
dv  <x| S>  - 


dv  <xjs>|— 


h  -2<y|<S>h 


•5hxx 


where 


d<  yjx,S> 


h  .  d4-,YlXfg> 

v  S? 


<  y  x,5> 


*  =  d2<  y2lxfs>| 


FIGURE  2-4.  The  Elements  Of  The  Approximate  Influence 
Matrix  For  The  Influence  Of  {x|s}  On  {y|o} 
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CHAPTER  3 


Developing  Decision  Models  from  Influence  Matrices 

3.1  Introduction 

The  influence  matrix,  as  developed  in  Chapter  2,  provides 
a  new  way  to  conceptualize  the  influence  of  a  variable's  proba¬ 
bility  distribution  on  the  profit  lottery.  In  this  chapter,  we 
show  how  this  conceptualization  can  be  used  in  the  development 
of  a  decision  model.  Though  judgment  still  remains  an  essential 
part  of  the  decision  model,  intuition  about  the  importance  of 
influences  in  the  model  is  not  required. 

3.2  Influence  Calculus 

Chapter  2  demonstrates  that  an  influence  calculus  exists  for 
general  influence  matrices.  The  simple  example  of  {x|£}  influencing 
{y|£}  influencing  {z|s}  suggests  that  the  influence  calculus 
could  be  used  to  reduce  complicated  influence  diagrams  to  simple 
diagrams  involving  only  a  few  variables.  This  simplification 
would  allow  one  to  describe  the  total  influence  of  any  variable 
in  the  diagram  on  the  profit  lottery. 

These  possibilities  motivate  the  more  thorough  development 
of  the  influence  calculus  presented  in  this  section.  We  begin 
by  demonstrating  a  general  procedure  for  computing  the  total  in¬ 
fluence  of  a  variable  on  any  other  variable  appearing  in  the 
influence  diagram.  The  total  influence  is  the  sum  of  its  direct 
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influence  on  the  variable  and  its  indirect  influences,  through 
intermediate  variables.  Next,  we  derive  the  mathematical  forms 
for  the  elements  of  the  influence  matrices  for  several  basic  in¬ 
fluence  diagrams. 

In  the  computation  of  the  elements  of  the  influence  matrices, 
we  sacrifice  the  generality  of  the  infinite,  exact  influence 
matrix  for  the  reduced  complexity  of  the  2x2  approximate 
matrix,  though  a  more  general  and  more  complicated  development 
is  possible.  The  influence  calculus  is  derived  for  influencing 
variables  that  are  continuous.  However,  it  is  also  applicable 
for  discrete  random  variables  and  mixtures  of  discrete  and  con¬ 
tinuous  random  variables. 


An  Influence  Evaluation  Procedure 


If  each  of  the  arrows  of  an  influence  diagram  is  labeled 
with  the  proper  influence  matrix,  then  the  equation  for  the  total 
influence  of  one  variable  on  another  can  be  easily  determined 
directly  from  the  diagram.  The  rule  for  labeling  influences  is 
very  simple.  An  influence  is  labeled  as  a  partial  influence, 


for  example 


3{z 

s } 

Fix 

"sT 

if  the  influenced  state  variable  is  in¬ 


fluenced  by  more  than  one  state  variable.  If  it  is  influenced 


by  only  one  other  state  variable,  then  it  is  labeled  as  a  total 

i£} 

\sj  • 


influence,  for  example 


Table  3-1  presents  and 


illustrates  a  procedure  for  determining  the  total  influence  equa¬ 
tion  that  uses  the  influence  diagram  and  is  applicable  to  com¬ 
plicated  diagrams.  The  results  of  the  procedure  for  several 
complex  diagrams  are  shown  in  Figure  3-1. 
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TABLE  3-1 


Procedure  for  Determining  the  Equation  for  the 
Total  Influence  of  One  Variable  Upon  Another 


Label  all  arrows  with  the  proper  influence  matrix.  An  arrow 
is  labeled  as  a  partial  influence  if  the  influenced  state 
variable  is  influenced  by  more  than  one  state  variable. 


Determine  the  direct  and  indirect  influence  paths  between  the 
tv/o  nodes 


({w]s  }] 


tx|5} 


Wh 


fel5)j 


d{z|S>  .  d{xlS)  3(z|s)  +  d{xj S)  d  {y  1 5}  3  {2 15} 
d{w|S}  d  {w|  S}  '3t*j  S>  d{w|s>  d{x|s>  3  {y|S} 

■  d(xl  S)  d  {z  |  S) 
d  (w|  5>  d  {x|  5> 


Uwl  S>) 


M  5>] 


M  s> 


C«|  8 } 


d{  zlS}  m  3  {y|S>  3  iz\S) 

dtwjS1}  3  {wjS}  3  {y|S} 


d  (z|s)  m  d  {xjg>  3  {zlfl}  +  a  {x  1  s>  3  {y  1 .9)  3  (z  1 <7} 

d {w 1 5 }  d{w|,j}  3  (x| 5}  d{w|s)  3  { x | ,9 >  3  {y|s) 

+  3_(yi£i  lJsJLslI 
3  4*|s}  3  fy\s) 


d  {x  1  S  }  d  {zls } 


3  {z  .9} 


d  {w | S }  d  {x | s }  3  {w| 5}  3  {y|s} 


FIGURE  3-1.  Examples  Of  The  Influence  Calculus  Using  The 
Procedure  Of  Table  3-1 


The  only  difficulty  in  evaluating  the  influence  of  one 
variable  on  another  is  that  all  of  the  elements  of  every  inter¬ 
mediate  influence  matrix  must  be  assessed. 

Expressions  for  those  elements  for  several  common  influence 
configurations  are  derived  next. 


A  Direct  and  An  Indirect  Influence 

Consider  the  problem  of  determining  the  total  effect  of  a 
change  in  the  marginal  distribution  of  a  state  variable  on  the 
distribution  of  another  state  variable.  Suppose  that  the  in¬ 
fluencing  state  variable  has  both  a  direct  influence  and  an  in- 

i 

direct  influence,  through  another  state  variable.  An  example  of 
this  problem  is  calculating  the  total  influence  of  {x|s}  on 
{z|s>  in  Figure  3-2. 


and  An  Indirect  Influence 

To  compute  the  total  influence,  we  begin  by  expanding 
<z]x,y,S>  in  a  Taylor's  series,  multiplying  by  {x,y|s)  ,  and 
integrating.  The  result  is 


(3.2.1)  <z|S>  =*  <z|x,y,S>  +  ^  fxx  v<x|s>  +  ^  f  V<y  |s>+  fxyCov  (x,y)  , 

where 
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Taking  th«  partial  derivative  with  respect  to  <x|S>  gives 


(3.2.2) 


3  <z  S  > 
§oT  S  > 


x,y 


£  +  f  acovQc^ 

x  xy  3  <x| S> 


x,y 


Notice  that  f  ,  f  ,  and  f  are  constants  by  tne  assump- 
xx  yy  xy 

tions  made  in  Chapter  2.  Equation  (3.2.2)  is  the  direct  influence 
of  <x|S>  on  <zjs>  .  To  evaluate  it/  the  change  in  the  co- 
variance  due  to  a  change  in  the  mean  of  {x|s}  must  be  determined. 

First,  we  can  express  Cov(x,y)  in  terms  of  the  moments  of 
{x|S}  ,  according  to  Appendix  A, 

n=l  “*  dx* 


(3.2.3) 


cov(x,y)  -  I  i, 


<  (x-x)n+1 15> 


A  similar  expression  could  be  derived  for  terms  of  the  form 
< (x-x)n (y-y)m|S>  ,  which  would  arise  if  terms  of  greater  than 
order  two  were  included  in  equation  (3.2.1).  Hence,  a  more  gen¬ 
eral  development  of  this  type  is  possible. 

If  the  conditional  surfaces  are  approximated  with  a  quadratic 
function  in  the  conditioning  variable  (approximation  2  of  Chapter 
2 ) ,  then 

(3.2.4)  Cov (x,y)  =  hx  v<x | S> +  |hxx  <(x-x) 3 | S> 


where 


_  8<y lx,5> 


3  x 


and  h 


xx 


3^<y |x,S> 


3x' 


Equation  (3.2.4)  expresses  Cov(x,y)  in  terms  of  <x|S>  ,  and 
v<x | S>  .  However,  Cov(x,y)  can  be  written  as  a  function  of 


<x|S>  and  <y|5>  using 


(3.2.5)  <y|S>  »  <ylx,5>  +  j  hXx  V<xls>  • 

Solving  (3.2.5)  for  v<x|s>  and  substituting  into  (3.2.4)  pro¬ 
duces  , 


2h  _  , 

(3.2.6)  Cov(x,y)  “  (<y |$>-<y |x,S>)  +  £  hxx  <  (x-x)  |S> 

X3C 


In  this  equation  <x|S>  and  <y|S>  are  independent  variables. 

As  a  result/  the  required  derivatives  of  Cov(xry)  can  be 
evaluated , 

.-2 


(3.2.7) 


a«rl»-<y|;.5»  -  2 


XX 


and 

(3.2.8) 


V  ,  2h  X 

hxx  -  r5 

xx 


3Cov (x,y)  „nx 
3<y|S>  4h  * 


xx 


Again,  hxx  is  constant  by  our  approximations  in  Chapter  2. 
Substituting  (3.2.7)  into  (3.2.2)  yields. 


(3.2.9) 


3<z 

s> 

5<x 

s> 

fx  +  fxy(hxx 


„  2h 

V<x  j  S>  -  -~- 
XX 


A  similar  expression  for  the  partial  derivative  with  respect  to 
<y|s>  can  be  obtained  with  the  help  of  (3.2.8), 


(3.2.10) 


3<z 

S> 

3<y 

S> 

*  f  .  +  2f 


x 


xy  h 


xx 
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This  equation  gives  the  direct  influence  of  <y|s>  on  <2|s>  . 
The  total  influence  of  <x|s>  on  <z|s>  can  be  obtained 


by  using  (3.2.9)  and  (3.2.10)  in 


(3.2.11) 


d<z I S> 


a<2  5> 


d<y i£> 


a**T*5-  x f y  x,y  x,y  x,y 


3<z|S> 


dv<y  S>  3<z | S> 

x,y  3v<y  | S>  x ,y 


Equation  (3.2.11)  says  that  the  total  influence  of  <x  S>  on 


<z|5>  is  the  sum  of  its  direct  influence  and  its  indirect  in¬ 
fluence.  The  factor  I  is  found  from  (3.2.1)  to  be  i  f 


fluence.  The  factor  ‘  - 

3  cy|5>  - 

x,y 


7  yy 


A  similar  derivation  leads  to  an  expression  for  the  influence 


of  v<x|S>  on  <z|S>  : 


d<z|g> 

d^<x I S>  -  - 
1  x,y 


3<z | S>  d<y | S>  3<z |g> 

3V<x | S>  -  dV<x | S>  - S<y'5>  - 

x,y  1  y  x#y 

+  <^<Y\S>  3  <z  | g>  | 


(3.2.12) 


dv<x|g>  3v<y|s’>  -  - 
1  J 1  x,y 


where 


3<z \S> 

3V<x|5>  - 

x,y 


3<z | S> 

3<y|S> 


1  f 

2  rxx' 


3<z  S> 
3v<y I S> 


1  fyy  ■  and 


f  +  f  r-— 

y  xy  h 

J  J  xx 


Equations  (3.2.11) and  (3.2.12),  along  with  expressions  for 


dv<z| S>  d<z2 | S>  ics  d<z \s> 

d<x  S>  d<x  5>  '  d<x  S> 
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d  <z  S>  _  d<z  S> 


d<z  S> 


can  be  combined  in  the  convenient  influence  matrix  form  for  the 
total  influence  of  (x|s)  on  {z|S}  ,  arsf-f}  * 


d(ajs}  _  \  d<z |S> 


dixTSj 


d  <z\S> 


dv< z I S> 
d<x|s:>  x,y 


dv<z  |  S>  I 


d  <x|S>  <x|S>  -- 


(3.2.13) 


_  3(z  |S)  d  {y  |S)  3{zjS) 
TCx|5T  d  (x  I  S }  3  iy  |s> 


The  total  influence  is  the  sum  of  the  direct  influence. 


a  (z|s) 


and  the  indirect  influence 


d{y]S)  3{z|s) 


.  Figures  3-3a  and 


3.3b  detail  the  elements  of  selected  matrices  of  this  equation. 


A  Special  Case 

A  special  case  of  two  influencing  variables  occurs  when 
either  of  the  following  conditions  holds: 

a)  Cov(x,y)  =  0 


3  <z lx,y> 
3x3y 


32<z2 | x,y> 
3x3y 


In  that  case,  Equation  (3.2.1)  reduces  to 

<Z|S>  -  <z|i,J,s>  +  fxx  v<x |s >  +  fyy  v<y|s>  , 


from  which  we  find 


jus.  . 

&|S) 


3  <  Il5> 

3  .<  x|S>  —  — 
1  x,y 


a  <»is> 

3  .<  x|S> - 

'  x,y 


3  <>!£> 

3V<x| S>  -  ~ 


3  V<  ll$> 


fx+*xv«WV<*ls>  -  VV 


fx  -2<  z|5>f  + 

<*W’«  xls.-^2/^) 

'V  ■  2<z|s>V 


•5fW  ”  <zl5>f. 


here 


h  -  d<  X»x'-‘ 

*  ax 


-  a  <ylx,s> 


f  =  3<zjx,y,S> 
X  3  X 


*_3<z  lx,y,S> 


f  * 

XX 


&  <zlx,3 


♦J2<z2|x,y^ 


XX  3x^ 


f  -3  2<  z 

--  ^  3  x 

x,y  x 

f 

--  xy 


FIGURE  3-3a,  The  Elements  Of  The  Influence  Matrices  Of 
Equation  (3,2,13) 


S<t 

3<x 


|S>  m  3<i| 


x*y,5> 


x,y 


These  conditions  produce  a  simplification  in  the  influence 

H r, lei 

matrix*  which  is  evident  comparing  '${4$ J-  as  shown  in  Figure 
3-3a  with 


(3.2.14) 


3{s|5)  _  fJ 

ynriTT  ■ 

1/2 


xx 


£x  -  2<*|S>£X  "I 

v*  4  -  <zlS>fxx 


The  direct  influence  matrix  of  (3.2.14)  can  be  determined  with¬ 
out  information  about  <y|x*5>  .  Furthermore*  under  these  condi¬ 
tions  we  have 


3<2 |x*y*5> 


d  X 

3<z |x,5> 
dx 


x*y 


*  * 

and  similar  expressions  for  f  *  f  ,  and  f  .  Hence*  the 

A  A 

elements  of  (3.2.14)  can  be  determined  independently  of  the  in¬ 
fluence  of  (y|5) 

Of  course*  condition  a)  holds  for  the  situation  depicted  in 
Figure  3-4.  In  that  case  there  are  no  indirect  influences, 
and  equation  (3.2.13)  simplifies  to 


(3.2.15) 


d{  2 

d(x 

where 


3{z 

5} 

3Txj 

5} 

is  given  by  (3.2.14) 
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Equation  (3.2.13)  and  Figure  3-3  show  tha  proper  definition 


of  the  influence  matrices  when  there  is  one  direct  and  one  in¬ 
direct  influence  on  a  variable.  The  development  of  the  equation 
can  readily  be  extended  to  a  higher  number  of  indirect  influences 


FIGURE  3-5.  An  Influence  Diagram  with  a  Direct 
and  Two  Indirect  Influences 

For  example,  for  the  influence  configuration  of  Figure  3-5,  the 
proper  influence  equation  is. 


The  elements  of  selected  matrices  are  displayed  in  Figure 
3-6a  and  3-6b. 

The  covariances  between  each  variable  that  influences  {z|S} 
and  all  of  the  other  influencing  state  variables  must  be  con¬ 
sidered  in  computing  the  direct  influence  of  that  variable. 

Evaluation  of  the  elements  of  (3.2.16)  requires  that  assess¬ 
ments  be  made  of  the  mean  and  variance  of  z  conditioned  on  the 
three  variables  x,y,  and  w  .  It  can  be  easily  extended  to  the 
case  of  more  than  three  influences  on  the  variable  z  .  In  fact, 
the  appropriate  equations  can  be  written  down  by  inspection  of 
(3.2.13)  and  (3.2.16).  The  practical  limitation  on  the  exten¬ 
sions  of  (3.2.16)  is  the  difficulty  of  assessing  moments  con¬ 
ditioned  on  more  than  three  variables. 


3 . 3  Influence  Vectors 

When  the  influenced  marginal  distribution  is  the  profit 
lottery,  it  is  sometimes  unnecessary  to  describe  the  influence 
on  the  entire  distribution.  Often  the  certain  equivalent  ade¬ 
quately  characterizes  the  profit  lottery.  In  those  instances 
a  description  of  the  influence  on  the  certain  equivalent  may  be 
sufficient. 

Howard  [5]  showed  that  the  certain  equivalent  could  be 
represented  as  a  power  series : 


where 


V< z  | S>  =  f  (-y) 

k=l  *' 


Y  =  the  decision  maker's  risk  aversion 
coefficient 
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}-6a.  The  Elements  Of  Selected  Influence  Matrices  Of 
Equation  (3.2.16) 


**  the  k^  cumulant  of  the  profit  lottery. 


By  truncating  the  series  and  evaluating  the  cumulants,  one  can 
obtain  an  expression  of  the  form 


(3.3.1) 

<z|£>  =* 

C^<z 

K 

\s>  +  I 

k-2 

Ck  <(z-z) 

k|S>  y^1 

For  example,  with 

K  -  2 

,  cx-i 

and  C2  = 

-  y  .  If  we  le 

(3.3.2) 

c  -  [cx 

c2y 

c3y2  .. 

•  0 

o 

o 

then  we 

can  define 

an  influence 

vector 

(3.3.3) 

d  ~<z  |s> 

d( 

z  i  S }  „  _ 

T  3  ~<z  |  S> 

3~<z  | S> 

dlxW' 

"  dT 

xpT  c 

[ 3<x|S> 

x  3<(x-x)2|5> 

According  to  this  equation,  the  influence  of  {x|s}  on  the 
certain  equivalent  of  the  profit  lottery  is  described  by  a  vector 
of  changes  in  ~<z|S>  resulting  from  changes  in  the  expectation 
and  central  moments  of  {x|5}  . 

The  influence  calculus  applies  to  influence  vectors  as  well 
as  influence  matrices.  For  example,  if 


d{z 

S } 

«  d{y 

S } 

,  d{z 

s} 

d{x 

TT 

d(x 

~sT 

diy 

'll  • 

then 


(3.3.4) 


d  ~<z  1  S> 

arrs 


if- 


d{z 

5} 

dix 

d{y i S) 

dix 

[ST 

d  ~<z  1 5> 
d  { y  |  S } 


A  special  case  of  Equation  (3.3.3)  occurs  when  k  =  l  in 


aquation 

(3.3.5) 


3.4  An  Example  Introducing  the  Influence  Consequence  Matrix 
We  have  shown  in  preceding  sections  that  the  influence 
matrices  when  combined  using  the  influence  calculus  establish 
how  changes  in  the  marginal  probability  distribution  of  a  state 
variable  affect  the  profit  lottery.  Wc  have  also  suggested 
that  the  relative  importance  of  these  changes  is  measurable  by 
the  change  in  the  certain  equivalent,  e.c*.  ~  •  In  this 

section  we  propose  a  method  for  combining  the  theory  of  influence 
with  the  judgment  of  the  analyst  as  an  aid  in  developing  the 
decision  model. 

To  illustrate  the  method,  we  make  use  of  a  modified  version 
of  the  entrepreneur ' s  decision  problem,  posed  by  Howard  [5]. 

The  entreprenuer  must  decide  upon  the  price  of  his  product  P 
in  the  face  of  uncertainty  about  demand,  q(P),  and  the  cost  of 
his  product  C(P).  His  profit  function  is 

Tr(C,q,P)  -  Pq(P)  -  Cq(P) 

The  variables  C  end  q  are  assumed  to  be  uncertain.  Letting 

AC  =  C  -  C 
Aq  =  q  -  q 

allows  definition  of  Atr  (AC,  Aq,P)  as 


(3.3.1),  then  (3.3.3)  becomes 


d<*  S> 

cTOTTF 


d{*  5} 

arnrsT 


[1  o 


.  .  ] 


"0 


d<z \s> 


d<z|5> 

d<(x-x)2|S> 
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(3.4.1)  Air(AC,Aq,P)  “  P[q(P)  +  Aq]  -  C[q(P)  +  Aq]  -  AC  -  7r(C,q,P) 


which  is  the  change  in  profit  due  to  fluctuations  of  C  and  q 
about  their  means.  Both  {Aq|s}  and  {AC|s}  have  means  of 
zero  and 

V<AC|S>  -  10000 
V<Aq|s>  *  100  . 

An  influence  diagram  for  the  original  problem  with  modifica¬ 
tions  is  shown  in  Figure  3-7.  The  random  variables  y  ,  e  ,  and  6 
have  been  added  and  the  dependencies  of  the  moments  of 
{AC|y,e,S}  and  {Aq|6,e,S}  are  presented  in  Figure  3-8.  For 
example,  e  can  be  thought  of  as  a  general  economic  indicator. 

As  e  increases  both  <Ac|y,e,S>  and  <Aq|6,e,S>  are  assumed 
to  increase  linearly,  but  the  corresponding  variances  do  not 
increase.  A  similar  remark  holds  for  the  relationship  between 
AC  and  e  .  The  following  marginal  probability  densities  have 
been  assumed: 


(3.4.2)  {y\S}  =  ^  0  <  5  <  10 

{ejS}  =  J  -  1  <  £  <  1 

U  \S)  =  26  0  <  6  <  1  . 

From  the  original  entreprenuer ' s  problem,  we  find 

(3.4.3)  Att  (0,  Aq,P*)  =  17.58Aq  +  .0249(Aq)2 
and 

(3.4.4)  Att(AC,0,P*)  =  -  AC 


where  P*  is  the  optimal  setting  of  P  when  AC  =  Aq  =  0  .  All 


62 


FIGURE  3-8.  Dependence  Of  The  Conditional  Means  And  Variance,,  For  The 
Modified  Entreprenuer ' s  Problem 


of  the  following  is  conditioned  on  P  ■  P*  . 

If  w«  assume  the  decision  maker  is  risk  neutral,  then  by 
(3.3.4)  the  influence  vectors  are 


3<Air  |P*,S> 
MAqjS) 

*  3<ir  |P*,S> 

3<Aq | S> 

lq 

3<tt  |P*,S> 
3V<Aq | S> 

J 

3<Air|P*,S>  _  | 

"■§TOjsT  1 

‘  3<n|P*,S> 

.  "T<faTs>  ' 

35 

3 <ir  |P*.S> 

3  <  Aq|S> 

J 

The  cross-partial  is  zero  according  to  (3.4.1). 
Therefore,  (3.4.5)  can  readily  be  evaluated,  using  (3.4.3)  and 
(3.4.4),  as 


/,  ,  r,  3<A*|P*,S>  _ 

(3<4*6)  TTSqTTJ 

-  f  Aq 

7  ^AqAq  ] 

m  | 

17.6 

1  T 

.025  J 

and 

3<A|P*,S> 

~5Ta5Ts7“ 

[  fAC 

1  f 

7  AC AC  J 

sx 

-  1 

1T 

°]  * 

The  elements  of  the  influence  matrices  for  state  variables 
y,<5,  and  e  can  be  determined  from  Figure  3-8.  The  matrices 
are  shown  in  Figure  3-9,  along  with  the  computations  for  the 
total  influence  on  the  profit  lottery. 

The  influence  matrices  can  be  useful  in  explaining  the  type 
and  strength  of  relationships  between  state  variables  and  the 
profit  lottery.  Examining  the  influence  matrices  shows  that 
{y|s}  affects  only  v<AC|s>  ,  and  v<AC|s>  does  not  affect 
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FIGURE  3-  9.  The  Influence  Matrices  For  The  Influences 
Of  y  #  5 1  and  e . 
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<ir |P*,£>  .  Consequently ,  neither  <y|S>  nor  v<y|S>  affect 
tho  expectation  of  the  profit  lottery.  On  the  other  hand, 
<w|P*,S>  is  affected  by  v<Aq|s>  .  Therefore,  (6|s>  affects 
the  profit  lottery  even  though  it  affects  only  v<Aq|5>  .  The 
effect  of  <6|s>  on  <n|P*,£>  is  small,  because  it  acts  though 
its  influenoe  on  v<Aq|S>  .  <e|S>  has  a  much  larger  effect  on 

<tt|p*,5>  ,  because  it  acts  though  its  influence  on  <Aq|S>  . 

The  effact  of  <e|£>  through  <Aq|S>  is  partially  offset  by  an 
opposing  effect  through  <AC|S>  . 


Selecting  Variables  for  the  Model 

Sometimes  the  influence  matrix  itself  will  indicate  that 
a  particular  variable  is  unimportant  to  the  problem  and  need  not 
be  included  in  the  model.  For  example,  since  <tt|p*,s>  is  un¬ 
affected  by  the  distribution  on  (6|s)  in  the  example,  the 
decision  maker  will  not  suffer  if  {6|s}  is  omitted  frorr.  the 
model. 


In  general,  the  analyst  must  use  his  judgment  to  interpret 
the  influence  matrix.  Figure  3-9  shows  that  <tt  I P* , £*>  is  more 
sensitive  to  the  mean  of  {ejs}  than  to  the  mean  of  {6|S>,  but 
is  less  sensitive  to  the  variance  of  { e  |  S' }  than  to  the  variance 
of  { 6  |  S’ }  .  Should  the  uncertainty  of  both  of  these  var  iables 
be  included  in  the  model,  or  only  one?  If  one  is  to  be  uncertain, 
which  one  should  it  be? 

To  clarify  the  roles  of  the  influence  matrices  and  the 
analyst's  judgment,  we  introduce  the  expression 


(3.4.6) 


i  *<x|5>  1 


a*  UJIfeJKtJl  ** 
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Th«  factor  dfl<* is  tha  fir#t  te.^m  of  the  influence  vector 

^dTx't^  °£  •<Juation  ^3.3.3) . 

In  the  context  of  the  influence  matrix,  we  think  of  it  as 

the  change  in  the  certain  equivalent  due  to  a  change  in  the  mean 
of  {x|5}  .  However,  it  may  also  be  interpreted  as  the  deter¬ 
ministic  sensitivity  of  the  certain  equivalent  to  a  unit  change 
in  the  variable  x  about  its  mean.  The  factor  A<x|s>  expresses 
the  decision  analyst's  judgment  about  the  difference  between  the 
mean  of  the  distribution  assigned  to  x  and  the  mean  of  the 


decision  maker's  authentic  distribution  on  x  .  This  difference 
may  be  due  to  difficulties  in  the  assessment  procedure,  a  hasty 
assessment,  or  the  fact  that  the  state  variable  is  influenced  by 
many  other  variables.  Therefore,  the  quantity  given  by  (3.4.6) 
is  the  change  in  the  certain  equivalent  that  results  from  ob¬ 
taining  an  authentic  mean  of  the  state  variable  distribution. 

If  the  value  of  expression  (3.4.6)  for  a  particular  state 
variable  is  a  large  fraction  of  the  certain  equivalent  or  the 
difference  between  certain  equivalents  for  different  decision 
settings,  additional  modeling  or  more  careful  assessment  of  that 
state  variable  is  warranted.  If  the  value  is  small.,  then  other 
state  variables  should  be  considered  for  additional  work. 

The  number  of  variables  that  are  treated  as  uncertain  in 
a  decision  analysis  problem  is  usually  constrained  to  six  or  seven 
due  to  time  and  budget  limitations.  Therefore,  identifying  which 
variables  should  be  represented  as  uncertain  is  an  important 
concern.  While  (3.4.6)  can  be  used  to  indicate  the  importance 


^ i  w _  <i  u  WV  ^  ^  */*_  ^  ■  ‘m\z  w*v  ’V*.  ‘  W“.  sfV 


of  further  modeling#  a  similar  expression  indicates  whether  a 

particular  state  variable  should  be  treated  as  a  random  variable 

or  whether  the  uncertainty  can  be  ignored  and  the  variable  fixed 

at  its  mean  value.  The  factor  in  expression  (3.4.7), 

dv<x|S>  - 

(3.4.7)  v<x|s> 

dv<x[S>  - 

is  the  second  element  of  the  influence  vector 

We  could  have  multiplied  d-5^lS>  by  a  factor  Av<x|s>  , 

dv<x|S> 

the  decision  analyst's  judgment  about  the  difference  between  the 
variance  of  the  assigned  distribtuion  and  the  authentic  distribu¬ 
tion  on  x  .  However#  by  multiplying  by  the  variance  v<x|S> 
rather  than  the  change  in  variance.  Equation  (3,4.7)  approximates 
the  change  in  certain  equivalent  that  results  from  fixing  x  at 
its  mean  and  not  treating  it  as  a  random  variable.  Appendix  B 
gives  a  proof  that  under  the  approximations  made  earlier 

(3.4.8)  3  v<x | S>  *~<z|S>  -  -<z|x  =  x,  S>  . 

3v<x|S> 

The  influence-consequence  matrix  of  Figure  3-10  conceptu¬ 
alizes  the  implications  of  the  various  combinations  of  magnitude 
for  the  modeling  indicators  of  (3.4.6)  and  (3.4.7).  The  top 
portion  of  each  matrix  entry  recommends  an  action  regarding  the 
improvement  of  the  authenticity  of  the  distribution  assigned  to 
the  state  variable.  In  the  lower  portion  of  each  entry  is  a 
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FIGURE  3-10.  The  Influence-Consequence  Matrix 


recommendation  about  whether  that  state  variable  should  be  con¬ 
sidered  as  uncertain  or  should  be  fixed  at  its  mean  in  the 
decision  model. 

Of  particular  interest  is  the  lower  left  element,  which 
corresponds  to  a  large  change  in  the  certain  equivalent  due  to 
anticipated  changes  in  the  expectation  of  the  state  variable, 
but  little  change  when  its  uncertainty  is  ignored.  In  this  case, 
further  modeling  is  recommended  to  more  accurately  determine  the 
mean  of  the  state  variable.  A  model  of  the  influences  on  t  ie 
mean  of  that  state  variable  might  include  uncertainty,  even 
tliough  -he  influenced  variable  itself  is  not  treated  as  uncertain 
in  the  decision  model.  To  our  knowledge,  this  option  has  not 
beei  exercised  in  decision  models,  ar„d  it  is  a  new  result  of  our 
analysis  of  influences. 

Returning  to  the  illustrative  entreprenuer ' s  problem,  Table 
3-2  shows  the  values  of  (3.4.6)  and  (3.4.7)  for  the  state  vari¬ 
able  y,$,  and  e  .  Since  a  numerical  estimate  of  the  difference 
between  the  assessed  mean  and  authentic  mean  is  required  for  each 
state  varia  j.  e,  we  have  assumed 

A  <x|S>  =  .1  V<x  |  S>  . 

This  expression  reflects  the  feeling  that  the  mean  of  a  broad 
distribution  is  less  authentic  than  the  mean  of  a  narrow  distribu¬ 
tion.  Of  course,  other  functional  forms  might  also  be  used. 

As  we  mentioned  above,  y  is  irrelevant  and  may  be 
ignored,  '’’treating  e  as  uncertain  is  not  necessary,  since  its 
uncertainty  only  contributes  .08  to  the  expected  value  of  200.5 
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Table  3-2 


The  Influence  of  the  Variables  y,  e,  and  s 
and  the  Modeling  Consequence 


Y 

6 

G 

a  <  it  |s> 

3  < • | S> 

0 

8.7 

76 

a  <ir  1 5> 

3 V<  * |  S> 

0 

6.6 

.25 

X  « 1  X  °<-|s> 

3<  •  |  S> 

0 

.16 

4.4 

x  v<.|5> 

3  <  *  |  S> 

0 

.37 

.08 

CONSEQUENCE 

No  Further 

Modeling 

No  Further 

Modeling 

Further 

Modeling 

Fixed  At 
Mean 


Uncertain 


Fixed  At 
Mean 


(from  the  reference  [5]).  e  may  be  fixed  at  its  mean.  However, 
our  estimate  of  the  difference  between  the  mean  of  the  authentic 
distribution  and  the  mean  of  the  assigned  distribution  on  e 
leads  to  a  change  of  4.4  in  the  expected  value.  Though  this  is 
a  small  percentage  of  the  expected  value,  further  modeling  of 
the  mean  of  {e|S}  is  more  important  than. further  modeling  of 
either  the  mean  or  variance  of  the  other  variables.  Of  the  three 
variables,  6  should  be  treated  as  uncertain  in  the  decision 
model.  Again,  its  effect  on  the  expectation  of  the  profit  lot¬ 
tery  is  small. 

Estimation  of  the  Error  in  the  Certain  Equivalent  Using 

Influence  Matrices 

In  addition  to  their  application  in  the  influence-consequence 
matrix,  the  total  influence  vector  can  be  used  to  give  an  estimate 
for  the  difference  between  the  certain  equivalent  of  the  model  and 
the  authentic  certain  equivalent.  If  A~<x|s>  is  that  difference, 
then 

(3.4.9)  A~<TrjS>  =  A<x|S>  +  Av<x|s> 

1  3v<x | S> 

where  A<x|S>  is,  as  defined  above,  the  analyst's  estimate  of 
the  difference  in  the  means  of  the  assigned  distribution  on  x 
and  the  authentic  distribution.  The  factor  Av<x|s>  is  defined 
similarly  to  A<x|£>  as  the  difference  in  the  variances  of  the 
assigned  distribution  and  the  authentic  distribution.  A  more 
general  form  for  (3.4.9)  is 
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A  “ <T\  |S> 


3~<tt|S> 

3<xi|S> 


A<xi(S’>  + 


3~<tt  lS> 

av<xi |s> 


9 


where  are  the  state  variables  on  which  marginal  distribu¬ 

tions  are  encoded.  In  influence  matrix  form, 


(3.4.10) 


A  ~<TT  |s> 


where  A{x. |s}  is  the  vector  of  differences  between  central 
moments  of  the  assessed  distribution  and  the  authentic  distribu¬ 
tion, 


A(x^)S)  =  [A<x^|S>  AV<x^|S> 


A.<  (x^— x^ ) 


\S> 


Equation  (3.4.10)  relates  dissatisfaction  with  the  profit 
lottery  to  estimates  of  the  error  in  the  assessment  of  state 
variable  distributions.  Other  researchers  have  related  that 
dissatisfaction  to  estimates  of  the  error  in  the  profit  lottery 
itself,  which  is  difficult  to  estimate.  We  believe  the  first 
element  A<x^| S>  of  the  vector  A{x^|s}  can  be  estimated  by 
the  analyst,  though  estimating  Av<x^|s>  is  probably  too  dif¬ 
ficult.  As  a  practical  matter,  the  difference  between  the  cer¬ 
tain  equivalent  of  the  modeled  profit  lottery  and  the  authentic 
profit  lottery  could  be  approximated  as 


(3.4.11) 


A  ~<v | S>  ~  ^ 

x. 


3~<v 

S> 

3<x^ 

S> 

A<xi|5> 


Using  the  information  in  Figure  3-9  for  the  entreprenuer ' s 
problem  we  estimate  the  error  in  the  certain  equivalent  to  be 
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0.  +  .16  +  4.4 
4.56 


3.5  The  Influence  of  Deterministically  Related  Variables 

Most  decision  problems  involve  deterministic  relationships 
between  some  of  the  problem  variables.  Usually  the  value  func¬ 
tion  is  a  deterministic  function  of  some  of  the  state  variables. 

In  the  entrepreneur's  problem,  for  example,  the  profit  is  deter¬ 
mined  by  AC  and  Aq  .  Because  of  the  frequency  of  such  rela¬ 
tionships,  this  special  case  of  influence  is  treated  in  this 
section. 

The  approximate  influence  matrices  for  {x|s}  determin¬ 
istically  influencing  {z|s}  and  for  {x|s>  and  {y|s}  deter¬ 
ministically  influencing  (z|S)  are  shown  in  Figures  3-lla  and 
3-llb.  These  elements  can  be  obtained  directly  by  differentiating 
the  expressions  for  <v(x)  |<S>  and  v<v(x)  |S>  given  as  Equations 
(4.2)  and  (4.5)  of  reference  [51 .  Using  the  deterministic  in¬ 
fluence  matrix  we  can  write  the  deterministic  influence  vector, 


(3.5.1) 


d~<z |s> 

d"{x"  |  S 1 


!" ?  -  yf  f  v<x 

l  x  '  x  xx 


S> 


T 


Let  x^  and  x^  be  two  independent  state  variables  that 
have  identical  marginal  probability  distributions,  but  have  dif¬ 
ferent  deterministic  sensitivities  (Figure  3-12) .  v  varies 
quadratically  with  x^  according  to  v(x^)  =  f  (x1)  and  linearly 
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with  x2  ,  v(x2)«  f2(x2).  By  expression 
the  certain  equivalent  due  to  fixing  x^ 
are,  respectively. 


(3.5.2) 


d'><v|g> 

dv<x1|S> 


r<Xl|s> 


(3.4.7) 
and  x 

+  J  f 


,  the  change  in 
2  at  their  means 


(3.5.3) 


■ ♦  i  v  v<x2is> 


dv<x2 \S> 


Now,  suppose  that  the  budget  constraint  on  the  analysis 
is  such  that  only  one  of  these  two  variables  can  be  included  in 
the  model  as  uncertain,  and  the  other  must  be  fixed  as  its  mean. 
Policy  regions  for  this  decision  as  a  function  of  the  decision 

i  • 

maker's  risk  tolerance  P  =  -  and  f-  can  be  obtained  by 

T  * 

equating  (3.5.2)  and  (3.5.3).  Figure  3-13  displays  the  resulting 
diagram. 


Risk  Neutral  Decision  Maker  Is  Concerned  About  Nonlinearit\ 


The  most  surprising  feature  of  the  figure  is  that  for  risk 


neutral  decision  makers,  x^  is  the  variable  that  should  be 
treated  as  uncertain  in  order  to  minimize  the  error  in  the  cer¬ 


tain  equivalent  of  the  profit  lottery.  This  result  is  easily 
seen  by  setting  y  »  0  in  Equations  (3.5.2)  and  (3.5.3).  It  is 
surprising  because  choice  between  x^  and  x2  does  not  de¬ 
pend  on  the  slope  of  the  deterministic  sensitivity  plot.  Even 


'enough  the  change  in  tue  cei taiu  equivalent  between  cXtiSuis 


values  of  x2  could  be  greater  than  the  change  between  extreme 
values  of  x^  ,  it  is  x^  that  should  be  included  as  uncertain. 
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FIGURE  3-13.  Modeling  P< 
Variable  x 
Of  Their  D< 


Risk  Tolerance 

p 


Treat  x. 
Uncertain 


/f 


VI 

1 


icy  Diagram  For  Treating  The 
or  x-  As  Uncertain  On  The  Basis 
:erministic  Sensitivities 


The  linear  variations  of  the  functions  f^(x)  and  f2(x) 
do  not  appear  in  the  expression  for  <v(x) |s>  .  Consequently, 
the  risk  neutral  decision  maker  needs  to  concentrate  only  on 
modeling  the  nonlinear  dependency  of  the  value  function  on  the 
state  variable  x^  ,  because  that  dependency  alters  the  expecta¬ 
tion  of  the  profit  lottery.  However,  the  linear  variations  of 
fx(x)  and  f 2 (x)  do  affect  the  variance  and  risk  premium.  As 
the  decision  maker's  risk  tolerance  decreases,  ne  is  increasingly 
concerned  with  the  risk  premium  and  the  linear  terms.  The  risk 
averse  decision  maker  must  balance  the  error  that  is  made  by 
ignoring  the  effect  of  f2(x)  on  the  risk  premium  against  the 

•  I  I 

errors  made  by  ignoring  the  effects  of  f^Cx)  and  f^  (x)  on 

I  I 

the  risk  premium  and  the  effect  of  f (x)  on  the  expectation  of 
the  profit  lottery. 

Dependency  of  the  Decision  Model  on  the  Decision  Maker 1 s 

Risk  Attitude 

Perhaps  a  more  important  philosophical  issue  suggested  by 
Figure  3-13  is  the  implication  that  the  choice  of  variables  for 
the  decision  model  should  depend  on  the  decision  maker's  risk 
attitude.  Two  decision  makers  with  the  same  information  about 
a  problem  but  with  different  risk  attitudes  may  model  a  decision 
problem  differently. 

Decision  analysts  have  always  distinguished  themselves 
from  other  modelers  by  insisting  that  the  specifications  of  a 
model.be  determined  by  a  particular  decision.  Our  work  suggests 
that  the  specifications  of  he  model  must  not  only  be  determined 
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by  a  particular  decision,  but  also  by  a  particular  decision 
maker.  For  decision  models,  as  for  probability,  there  is  no 
objectively  correct  model.  The  appropriate  model  depends  on 
the  preferences  and  beliefs  of  the  decision  maker. 

An  Example  Showing  How  Risk  Attitude  Affects  the 

DecisionModel 

In  order  to  determine  the  magnitude  of  the  impact  of 
risk  attitude  on  the  decision  model,  in  this  section  we  apply  our 
results  to  a  decision  analysis  of  an  actual  investment,  which  has 
not  been  published  because  of  its  proprietary  nature. 

The  decision  problem  was  to  select  strategies  to  maxi¬ 
mize  the  net  present  value  of  a  new  service  venture.  Figure  3-14 
shows  the  deterministic  sensitivity  results  for  the  seven  most 
important  variables:  service  price,  equilibrium  plant  capacity, 
start-up  date,  governmental  restriction,  transfer  payment,  future 
competition,  and  initial  plant  capacity.  A  brief  explanation 
of  each  variable  is  given  in  Table  3-3.  The  analysis  is  not  sensi¬ 
tive  to  the  cost  of  the  project  since  the  service  facility  has 
been  constructed. 

Suppose  that  a  total  of  five  variables  can  be  treated  as 
uncertain  and  four  of  the  five,  x^,  Xj,  x^,  and  x^  ,  have  been 
selected.  What  recommendation  can  be  made  regarding  the  variables 
x5,  Xg,  and  x^  ?  The  functional  forms  of  the  deterministic 
sensitivities  to  these  variables  are  presented  in  Figure  3-15. 
Table  3-4  lists  the  first  and  second  derivatives  of  these  sensi¬ 
tivities,  the  means  and  variances  of  the  state  variable  proba¬ 
bility  distributions,  and  the  values  of  the  expressions 
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TABLE  3-3 


Brief  Explanation  of  the  State 
Variables  in  the  Example  Problem 


x^  Service  Price 


x.  Equilibrium 
4  Plant  Capacity 


x3  Start-up  Date 


x.  Governmental 
4  Restriction 


x.  Transfer 
^  Payment 


Since  this  service  is  unique  in  the  U.S., 
a  large  uncertainty  exists  about  the 
demand  curve. 

Though  the  plant  that  provides  the  service 
is  constructed,  it  has  not  operated,  and 
new  technology  is  involved. 

Even  if  the  owners  decide  to  begin  plant 
operation  as  soon  as  possible,  the  actual 
start-up  date  is  uncertain.  Delayed 
start-up  reduces  the  present  value  of  the 
profit  stream. 

Because  the  client  is  currently  the  only 
company  able  to  provide  this  service,  the 
possibility  of  government  restriction  of 
profit  exists. 

Part  of  the  service  is  performed  by  another 
company.  The  cost  of  that  service  is  un¬ 
certain. 


x6  Future 

Competition 


Competitors  may  enter  the  market  in  the 
future. 


x_  Initial  Plant 
1  Capacity 


The  plant  is  expected  to  start  production 
at  less  than  equilibrium  capacity.  Early 
capacity  is  uncertain,  however. 


v,net  present 
value 


”590 


d~<v|S> 
3<x^ \S> 


{ .  l)°<x  |  S> 
*i 


and 


d~<v|g> 

dv<x^ |s> 


v<x^|s> 

x 


Recall  these  last  two  expressions  approximate,  respectively,  the 
change  in  the  certain  equivalent  due  to  a  change  in  the  mean  of 
a  state  variable  and  the  change  in  the  certain  equivalent  due 
to  ignoring  uncertainty  in  the  state  variable. 

This  table  reveals  that  the  variable  with  the  largest 
deterministic  sensitivity  xg  is  not  the  first  one  that  should  be 
treated  probabilistically.  To  the  contrary,  x?  ,  with  the 
smallest  sensitivity  would  produce  the  greatest  change  in  cer¬ 
tain  equivalent  if  its  uncertainty  was  ignored.  As  we  discussed, 
in  the  previous  section  this  effect  is  the  result  of  the  non¬ 
linearity  of  the  determinis  sensitivity  of  x7  ,  as  seen  in 
Figure  3-15. 

As  we  might  expect,  obtaining  an  authentic  mean  for  vari¬ 
able  Xj.  is  more  important  than  for  variables  xg  and  x7  . 

Upon  inspection  of  the  influence  consequence  mi  ;  (Figure 
3-10),  of  the  three  variables  xg,  xg,  and  x^,  xg  and  xg 
should  be  fixed  at  their  means,  but  xg  should  be  carefully 
assessed  or  futher  modeled. 

Finally,  the  modeling  policy  diagram  for  the  decision  to 
treat  xg  or  x7  as  uncertain  is  shown  in  Figure  3-16. 
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FIGURE  3-16,  Modeling  Policy  Diagram  For  Treating  The  Variable 
x5  Or  x7  As  Uncertain  Showing  The  Location  Of  The 
Transfer  Price  Deterministic  Sensitivity 


CHAPTER  4 


A  Compariecu  of  the  Quadratic 
Approximation  with  Discretization 

4.1  Introduction 

We  begin  this  chapter  by  showing  what  factor  determines 
the  information  required  to  compute  exactly  the  moments  of  the 
profit  lottery.  If  the  conditional  moments  of  the  profit  lottery 
are  polynomials  of  degree  k  in  the  conditioning  variable,  then 
those  moments  must  be  assessed  at  k  +  1  values  of  the  state 
variable.  Furthermore,  only  k  moments  of  the  marginal  distribu¬ 
tion  are  required.  Hence,  it  is  the  functional  form  of  the  con¬ 
ditional  surface  that  determines  the  required  information. 

Our  use  of  influence  matrices  depends  on  approximating  the 
conditional  moments  by  quadratic  functions.  In  Section  4.3  of 
t.hi3  chapter,  we  present  procedures  for  assessing  the  information 
required  by  the  quadratic  approximation. 

Since  current  practice  for  computing  the  profit  lottery  is 
to  discretize  the  conditional  distribution,  in  Section  4.4  we 
compare  discretization  with  the  quadratic  approximation.  We  find 
that  neither  the  quadratic  approximation  nor  discretization  holds 
a  clear  advantage.  Our  sample  problem  does  demonstrate  a  defi¬ 
ciency  in  discretization  that  is  not  generally  appreciated. 

While  discretization  of  the  marginal  distribution  preserves  the 
mean  of  the  marginal  distribution,  it  does  not  generally  yield 
the  correct  mean  of  the  profit  lottery. 

A  related  result  of  this  chapter  is  a  derivation  of  dis¬ 
cretization  showing  under  what  conditions  discretization  of  a 
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state  variable  will  lead  to  the  correct  moments  of  the  profit 
lottery.  This  derivation  is  identical  to  the  derivation  of  the 
quadratic  procedure.  The  only  difference  between  discretization 
and  the  quadratic  procedure  is  in  the  assumption  about  the  con¬ 
ditional  moments  of  the  profit  lottery  given  the  value  of  the 
state  variable. 

Since  the  theoretical  derivation  of  the  quadratic  method 
differs  from  discretization  in  the  assumption  about  the  condi¬ 
tional  moments  and  since  the  quadratic  method  is  comparable  to 
discretization  in  both  ease  of  assessment  and  accuracy,  it  should 
be  considered  as  an  alternate  method  for  the  solution  of  decision 
problems  directly  from  their  influence  diagrams. 


4.2  An  Overview  of  Two  Proposed  Assessment  Procedures 

Consider  the  problems  of  estimating  the  marginal  probability 
distribution  on  a  variable  y  that  is  influenced  by  another  vari¬ 
able  x  * 


{y|s}  might  be  the  profit  lottery  ana  x  a  state  variable  that 
influences  y  through  several  intermediate  state  variables,  or 
y  might  be  another  state  variable  directly  influenced  by  (x|S). 

In  either  case,  our  earlier  result,  equation  (2.2.2),  indi¬ 
cates  that 

.n_  mi 


<ym|5>  =  <ym|x  =  x,S>  +  l 

n=2  n*  dx11 


< (x  -  x)  |S> 


x 


Now,  suppose  that  <ym]x,S>  is  approximated  by  a  polynomial  of 
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degree  k  .  Than  this  aquation  becomes  a  finite  sum  of  terms, 

k  , 


(4.2.1)  <ym|S>  =  <y®jx  -  x,S>  +  ?  K  - 

n-2  n*  dxn 


s> 


< (x  -  X)n|s> 


mi 


The  error  in  the  estimation  of  <y  | S>  due  to  the  approximation 

is 


.  f  k  dn<yml x, 
n-k+1  n!  dx11 


5> 


<  (x  -  x)n | S> 


If  <ym|x,S>  and  (x|s)  are  known,  this  expression  can  be  used 
to  obtain  the  value  of  <ym[5>  within  any  desired  degree  of 
accuracy.  It  should  be  clear  from  equation  (4.2.1)  that  as  one 
increases  k  and  the  accuracy  of  the  approximation,  more  and 
more  information  is  required  about  the  conditional  surface.  Using 
equation  (4.2.1)  required  knowledge  of  <ym|x,S>  at  k+1  values 
of  x  in  order  to  determine  the  k  derivative  of  <y  |x,S>. 

In  the  remainder  of  the  chapter  we  discuss  assessment  proce¬ 
dures  for  the  case  of  k  »  2  ,  in  which  the  moments  of  y  are 
approximated  as  quadratic  functions  of  x  .  These  procedures  can 
be  extended  for  higher  values  of  k  ,  though  additional  assessments 
are  required. 

If  we  approximate  the  conditional  moment  by  a  quadratic  func¬ 
tion  of  x  and  restrict  our  attention  to  means  and  variances, 
(4.2.1)  becomes 


(4.2.2a)  <y|s>  Z  <y|x  =  x,S> 


,  1  d  <yjx,5> 

2  ,2 


dx 


r<x  j  S> 


(4.2.2b) 


<y2 | S>  Z  <y2 | x 


-  ;,S>  +  i 


dx 


r<x  I S  > 
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We  propose  two  procedures  for  obtaining  the  information 
required  by  (4.2.2).  First,  by  assessing  {y|x  »  xrsl  ,  the 
analyst  can  compute  <y|x  ■  x,  S>  and  °<y|x  *  x4s>.  If  the 
decision  maker  is  familiar  with  the  concepts  of  conditional  mean 
and  conditional  standard  deviation,  the  analyst  can  then  ask  for 
the  shape  of  <y|x,5>  and  °<yjx,S>  as  functions  of  x  .  The 
two  points  <y|x  •  x,S>  and  °<y|x  ■  x,S>  are  combined  with  the 
respective  shapes  to  obtain  <yjx,S>  and  °<y|x,S>  .  From  these 
two  curves  the  required  second  derivatives  can  be  approximated. 

This  entire  procedure  is  discussed  more  thoroughly  and  demonstrated 
in  the  next  section. 

A  second  procedure  for  less  technical  decision  makers  is  to 
assess  {y|x,S}  at  two  values  of  x  in  addition  to  x  .  For 
example,  if  {y |x  + °<x|S>,S) ,  {y|x,S},  and  {y|x  -  °<x|s>,s}  are 

assessed,  corresponding  values  of  the  conditional  mean  and  second 


moments  can  be  computed.  The  second  derivatives  required  for 

(4.2.2)  could  be  obtained  using  a  three-point  approximation. 
However,  when  the  entire  distribution  (yix,S)  is  assessed 

at  three  points,  it  is  possible  to  estimate  the  marginal  distribu¬ 
tion  (y|S)  ,  rather  than  just  its  mean  and  variance.  Instead  of 

(4.2.2) ,  a  similar  equation  with  a  similar  derivation  is  used. 


(4.2.3) 


{y|S}  I  {y|x  ■  x,5)  +  i  — JY,,** 

3  x* 


<x  S> 


This  approximation  i3  exact  when  (y|x,5)  is  quadratic  in  x  . 

The  second  procedure,  which  estimates  {y|S}  ,  is  also  demonstrated 
in  the  next  section. 


Notice  that  both  quadratic  procedures  can  be  applied 
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repetitively.  That  is,  for  the  situation  of  {x|s>  influencing 
(y|S>  influencing  (*js)  ,  equations  (4.2.2)  or  (4.2.3)  can  be 
used  to  obtain  <y|£>  and  v<y|s>  .  These  two  moments  and  the 
appropriate  assessments  of  {*jy,S)  can  ba  used  in  equations 
like  (4.2.2)  or  (4.2.3)  to  obtain  either  <z|S>  and  <z2|s>  or 
the  entire  distribution  (ajs). 

Using  the  approximation  for  the  covariance  introduced  in 
Chapter  3,  equation  (3.2.4),  both  equations  can  be  extended  to 
include  situations  where  the  profit  lottery  is  influenced  by  more 
than  one  variable.  For  example,  corresponding  to  the  influence 
diagram, 


the  equation  for  {z|s>  is 

,2 


fa|s>  :  («|St,y,s> 


v<x|g>+l  I  tgJx,Y/g} 


x,y 


Dy* 


<y  5> 


x,y 


(4.2.4) 


+  32(z|x,y,S} 


3x3y 


3<yj x,  S  > 


x,y 


fx 


r<xi  s>  +  L<n*t5> 


3x 


<  (x-x) 3 | S> 


Again,  this  equation  can  be  applied  repetitively. 

The  information  that  must  be  assessed  to  obtain  the  marginal 
distribution  by  (4.2.4)  or  (4.2.3)  or  the  moments  by  (4.2.2)  is 
the  same  information  required  to  obtain  the  influence  matrices  in 
those  cases.  Hence,  the  assessments  -required  to  determine  all  of 
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the  influence  metric*!  for  e  given  influence  diagram  can  also  be 
used  to  estimate  the  profit  lottery. 

4.3.  An  Example  Demonstrating  the  Two  Quadratic  Procedures 
In  a  demonstration  of  the  two  quadratic  procedures  for 
computing  the  properties  of  the  profit  lottery,  consider  the  age 
and  income  distributions  for  males  ages  25  through  64  according 
to  the  U.  S.  Census  [19].  Suppose  that  the  decision  maker  is 
familiar  with  the  age  distribution  of  that  population  and  the 
conditional  income  distribution  given  age.  Then,  two  procedures, 
based  on  equations  (4.2.2)  and  (4.2.3)  are  available  to  approxi¬ 
mate  the  marginal  income  distributions. 

Procedure  I:  Assessment  of  Conditional  Mean 
and  Conditional  Variance 

Equation  (4.2,2)  can  be  used  to  approximate  the  mean  and 
variance  of  the  marginal  distribution  on  income  with  the  assess¬ 
ment  of  only  two  probability  distributions.  Figure  4-1  is  a  flow 
chart  for  this  procedure.  The  marginal  distribution  on  age  for 
males  ages  25  through  64,  shown  in  Figure  4-2,  is  assessed  in 
order  to  compute  its  mean  and  variance.  According  to  the  figure, 
these  values  are  43.7  and  126,  respectively.  After  the  mean  of 
the  age  distribution  is  determined,  the  distribution  of  income 
conditional  on  the  mean  age  is  assessed.  Then,  the  mean  and  vari¬ 
ance  of  income  conditioned  on  the  mean  age  can  be  computed. 

The  mean  income  at  the  mean  age  is  used  as  a  benchmark  in 
obtaining  the  curve  of  mean  income  as  a  function  of  age.  The  deci¬ 
sion  maker  is  asked  how  his  estimate  of  the  mean  income  would 
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<x|s>?v«*|s> 
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<X|x,s»»°<l|*.S> 


f«|S> 


Ainu 

«xjx,s> 


Ainu 

®<X|x,S> 


Compute 

«I2|x,s> 


Quadratic  Fit 

<l|x»s>  -  a.(x-x)‘ 
♦b, (x-x)  +c, 


Quadratic  Fit 

2  — *  2 

<1  |x,s>  »_a2 (x-x) 

♦b, (x-x)  S-c, 


Equation  (4.2.2a)  }  Equation  (4.2.2b) 


^<1 >  ■ 

<I2|S>  -  <l|s>2 


r<I  |5» 


FIGURE  4-1.  Flow  Chart  For  The  Quadratic  Approximat ion  Pro 
cedure  Using  Conditional  Mean  And  Variance 


FIGURE  4-2.  The  Marg 


change  at  tha  revealed  valua  of  aga  incraataa  and  dacraataa  from 
tha  aaan  of  tha  aga  distribution.  Similarly,  tha  standard  devia¬ 
tion  of  incoma  at  tha  maan  aga  providas  a  benchmark  for  assessing 
tha  conditional  standard  daviation  as  a  function  of  age.  The 
curves  of  conditional  mean  income  and  income  standard  deviation 
computed  for  the  census  data  are  presented  in  Figure  4-3. 

Of  course,  the  conditional  standard  deviation  is  a  difficult 
concept,  and  not  all  decision  makers  will  be  able  to  draw  the  re¬ 
quired  graph,  even  with  the  benchmark.  It  may  be  necessary  to  do 
additional  assessment  in  order  to  help  the  decision  maker  estimate 
tha  conditional  standard  deviation.  However,  if  it  is  necessary 
to  assess  carefully  the  entire  conditional  distribution  at  several 
values  of  the  conditioning  variable,  then  the  second  procedure, 
discussed  below,  should  be  used. 

Once  the  curves  of  conditional  mean  and  standard  deviation 
have  been  assessed,  the  conditional  second  moment  can  be  computed 

as  a  function  of  the  conditioning  variable.  The  conditional  second 

2 

moment  of  income  given  age  <1  |x,S>  is  also  shown  in  Figure  4-3. 

2 

Each  curve,  <l|x,S>  and  <1  jx,S>  ,  is  fit  with  a  quadratic  func¬ 
tion  and,  the  coefficients  are  then  used  in  equation  (4.2.2)  to 


compute  the  moments  of  the  influenced  marginal  distribution.  For 
our  example,  we  have 

<ils>  -  <ilx,s>  +id-  <:I1%*S> I  v<x I s> 


Id 

<llx,S> 

2 

2 

dx* 

=  10350  (-17.3)  (126) 


-  9260 


97 


r-vV- 


j$,i- 

■' 


H  if  . 


<I2|S>  -  <I2|x,S>  +  |  — j2^x^g> 


dx 


r<x|s> 


«>  147  x  106  '  (-  .494  x  106)  (126) 

-  116  x  106 


and 


v*t2|S> - 2 

-  30.0  x  10 


<I2|S>  •  <I2  j  S>  -  <1 1 5> 

6 


Procedure  lit  Assessment  of  Conditional  Distributions 
Approximating  the  age  distribution  using  equation  (4.2.3) 
requires  the  assessment  of  four  complete  distributions.  Figure 
4-4  displays  a  flow  chart  for  this  procedure.  The  necessary 
assessments  are  the  marginal  age  distribution  {x|s>  and  three 
distributions  for  income  conditioned  on  particular  values  of  age. 
The  conditioning  values  of  age  are  selected  to  give  a  good  qua¬ 
dratic  approximation  to  the  age- income  surface.  For  --xample,  the 
following  equation  works  well 
3  2 { 1 1 x,g) 


dx 

(4.3.1) 


-  (  I  1  X=x  +  g<X  1  S>  ,s}~  {I  [x=x  ,s)  (l|x=X,S}-{l|x=X'  w<J<x  [g  >,s) 


<X\S> 


<x  S> 


<X  S> 


Therefore ,  the  conditioning  values  of  age  for  the  three  assessments 
of  income  distribution  depend  on  the  mean  and  standard  deviation  of 
the  age  distribution. 

From  the  marginal  distribution  on  age  (Figure  4-2),  the  mean 
age  of  .that  population  is  43.7,  and  its  variance  is  126.  The  three 
required  distributions  of  income  conditioned  on  age  are  shown  in 
Figure  4-5.  These  distributions  are  used  in  equation  (4.3.1)  to 
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{I  | S'} 


I 

i 

I 

•  I 

FIGURE  4-4.  Flow  Chart  For  The  Quadratic  Approximation  Pro¬ 
cedure  Using  Three  Conditional  Distributions 
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which  is  used  along  with  {l|x^x,s}  in 


equation  (4.2.3)  in  obtaining  {l|s}  .  Figure  4-6  displays  the 
uneveneas  of  the  surface  {l|x,5}  and  also  shows  the  quadratic 
approximation  to  the  surface.  According  to  Figure  4-7,  the 
quadratic  approximation  for  the  marginal  income  distribution 
closely  matches  the  exact  distribution. 

The  Conventional  Procedure :  Discretization 
In  contrast  to  the  quadratic  methods,  Figure  4-8  diagrams 
the  steps  in  approximating  (l|s)  using  the  conventional  discrete 
method.  Again,  four  complete  distributions  must  be  assessed:  the 
marginal  distribution  on  age  and  three  conditional  income  distri¬ 
butions.  Following  the  assessments,  each  distribution  is  dis¬ 
cretized  to  find  the  expectation  in  each  interval. 

The  marginal  distribution  on  age  used  in  the  discretization 
(Figure  4-2)  is  the  same  one  used  for  the  quadratic  approximation. 
It  is  discretized  at  the  points 

<xjx  <_  275  x , S>  -  30 

<x|  .275  x<  x  —  .80  x,^>  =  43.7 
<x|  _80x  <  x,S>  =  60 

in  order  to  reduce  the  amount  of  data  interpolation  required.  The 

notation  x  refers  to  the  p-fractile  of  (xls)  .  Conditional 
P 

distributions  {l|x,S}  are  assessed  at  each  of  the  three  ages 
given  in  (4.3.2)  and  discretized. 

In  Figure  4-9,  the  discretization  of  the  age  and  conditional 
income  distributions  is  displayed  as  an  event  tree.  By  taking  the 


bility 
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FIGURE  4-6.  Two  Slices  Through  The  Condi 
The  Quadratic  Approximation 


{I|s> 


FIGURE  4-8.  Flow  Diagram  For  The  Conventional  Method 
Of  Discretization 
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Income 


Product 

Probabilit 


product  of  the  event  tree  probabilities,  "rolling  the  tree  for¬ 
ward",  the  marginal  distribution  on  income  can  be  approximated. 

The  discrete  approximation  is  plotted  along  with  the  quadratic 
approximation  and  the  exact  distribution  in  Figure  4-7. 

It  is  evident  from  Figure  4-7  that  the  quadratic  approxima¬ 
tion  is  quite  accurate,  and  the  discrete  approximation  is  less 
accurate.  However,  the  tabulation  of  Table  4-1,  comparing  the 
moments  of  the  approximation  with  the  exact  values,  shows  the 
discrete  and  continuous  approximations  to  be  comparable  and 
acceptable.  In  the  next  section  the  theoretical  basis  for  dis¬ 
cretization  is  investigated,  and  the  reason  for  its  overestima¬ 
tion  of  the  expected  income  is  explained. 

4.4  Comparison  of  Discretization  With  the  Quadratic  Approximation 
The  degree  of  confidence  that  we  have  in  a  model  structure 
resulting  from  influence  matrices  and  our  use  of  the  associated 
estimate  of  the  profit  lottery  depends  on  the  accuracy  of  the 
quadratic  approximation.  If  the  approximation  is  crude,  then  the 
influence  matrices  can  only  provide  the  analyst  with  a  means  to 
conceptualize  the  modeling  process.  The  associated  estimate  of 
the  profit  lottery  would  need  to  be  verified  by  more  exact  methods. 
On  the  other  hand,  if  the  quadratic  approximation  is  sufficiently 
accurate,  then  the  influence  method  would  yield  a  model  structure 
in  which  the  analyst  is  confident.  Furthermore,  additional  re¬ 
search  to  determine  how  to  use  the  estimates  of  the  profit  lottery 
to  solve  the  decision  problem  directly  from  the  influence  diagram 
would  be  warranted. 
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TABLE  4-1 


Comparison  of  ths  Discrsts  and  Quadratic  Methods 
with  the  Exact  Distribution 


Quantity 

Ex»ct 

Discrete 

Quadratic 

Expectation 

9218 

9399 

9256 

<i|s> 

- 

2« 

0% 

Second  Moment 

119  x  106 

124  x  106 

116  x  1 

The  moat  frequently  used  method  for  computing  the  momenta 
of  a  diatribution  that  ia  dependent  on  another  variable  is  dis¬ 
cretisation  of  the  influencing  variable.  Discretisation  meana 
dividing  the  range  of  x  into  intervals  and  associating  tha 
probability  weight  from  an  interval  with  a  point  within  that 
interval.  For  example,  if  (xjs)  is  a  normal  distribution,  the 
analyst  can  divide  x  into  three  intervals  at  the  25%  and  75% 
fractiles  of  {xjs)  ,  denoted  25x  and  75*  »  respectively. 
Then,  he  can  assign  probability  weights  of  .25,  .50,  and  .25 
to  the  points 

<*l  -  »  *  <.25x>  =  . 10X 

<xl.25x  i  x  <.75X>  :  . 50x 
<xl .75*  <  x  <  “  >  :  ,90x 

This  procedure  preserves  the  expectation  of  (x|S)  ,  since 
<x|S>  =  <x|x  <  25x,5>  *{  25X | S} 

+  <x\  25x<x<15x,s>  [S{<75x|s}  -  % 25x | S) ] 

+  <x|  75x^x,S>  [1  -s{  7^x  j  5}  ] 

When  {x|s)  influences  (y|s)  ,  the  moments  of  Cy|s}  can 
be  approximated  by  repeating  the  procedure.  At  each  of  the  points 
given  in  (4.4.1)  the  analyst  discretizes  the  conditional  distri¬ 
bution  {y|x,s)  .  The  discretization  preserves  the  moments  of 
the  conditional  distribution,  since, 

<ym!x,S>  =  <ym|y  <25y,x's>^ .25ylx'5* 

+  <ym|  .25y  -  y  <.75y,x'S>  l*{.75ylx's}  "  *{.25yix's}] 

+  <yml  >75yiy#xiS>  U  -  s{  75y| x,s>] 
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However,  the  moments  of  the  marginal  distribution,  (y|s)  ,  ars 
only  approx  iota  tad  as, 

<y“|S>  Z  <yn|x  -  <xlx  <  25x>,5>  *{ .25xI$) 

(4.4.3)  ♦  <y“l*  -  <xl  ,25x  1  x<75x>#S>I€{.75xk}  -  *(<25xl5} 

t 

+  <y*|x  »  <x|  75x  £  x  >,S> (1  -  *{  75x|s)) 
or  liora  ganarally 

_  H+l  _  ^ 

(4.4.4)  <y“|s>  Z  ?  <y°|x  ■  <x|xn-1  ix<xn>,5  >  (*{xn|s)  -  •(x^jjs)! 

n«l  5 

where  xQ  *  -  •  and  xN+1  -  ♦  •  . 

Nhila  discratisation  of  (x|S)  praserves  the  moments, of  the 
state  variable  distribution  {x|s}  ,  it  only  approximates  the 
momonts  of  the  profit  lottery  {y|S}  . 

An  Example  Showing  that  the  Moments  of  the  Profit  Lottery 
Kay  tie  Overestimated  or  Underestimated  by  Discretisation 

Suppose  that  (x|s)  is  a  normal  distribution  with  standard 

deviation  ox  and  that 

<yn|*,S>  -  V2  +  bm*  +  c»  • 

Using  equation  (4.4.3),  the  approximate  value  obtained  by  dis¬ 
cretization  at  the  points  of  (4.4.1)  is 

<ym|jD,S>  «  a  Jc*  +  .82  am  V<x|s>  +  b  x  +  c 
m  m  1  ro  m 

-2  - 

Since  the  exact  value  is  a„x  +  b  x  +  c  ,  the  error  due  to 

m  mm 

discretization  is 

(4.4.5)  <ym|S>  -  <ym|0,5>  »  -r  .18  am  v<x|s> 

where.  D  denotes  the  value  computed  using  the  discretization 
procedure.  From  (4.4.5)  the  errors  in  the  mean  and  variance  of 
(y|s)  are  found  to  be 


(4.4.6)  <y|S>  -  <y|i>,S>  ■  .18  a^  v<x|s> 

v<y|5>  -v<y|0#5>  ■  *•  .18  a^  V<*ls>  -  .36  ^  V<X|‘5>  <y|s> 

-  .097  aj  v<x|S>2  . 

The  implication  of  thaaa  equation*  is  displayed  in  Figure 
4-10.  Thara  will  always  be  an  error  in  the  mean  of  the  profit 
lottery  unless  a^  -  0  ,  and  whether  it  is  overestimated  or 
underestimated  depends  on  the  sign  of  a^  .  In  either  case,  the 
variance  of  the  profit  lottery  may  be  overestimated  or  underestimated.  & 


Derivation  of  the  Discrete  Approximation 
These  considerations  motivate  an  investigation  of  the  con¬ 
ditions  under  which  discretisation,  as  in  equation  (4.4.4).  is 
exact.  We  begin  with  the  expansion  equation 

<ymjs>  -  f  <ym|x,5>  (x|s)dx  . 

Jx 

and  divide  the  integration  into  regions 

(4.4.7)  <ym|S>  -  f  1  <ym|x,S>{x|S)dx  +  ...  f  k  <ym| x.S>(x| S)dx 

^  V  J  V 


kk-l 


+ r*  <y- 

JxK-l 


|x,S>{x|s)dx 


Within  each  region  the  conditional  moment  can  be  expanded  in  a 
Taylor's  series  about  the  expectation  of  x  in  that  interval. 

(4.4.8)  <ym|x.S>  *  <ym|x  «  <x|xek>.S> 


(x  -  <x|x£k>)n 

<x|xek> 


where  k  ■  {x;  xJc_1<x£xk} 


Substituting  (4.4.8) 


i 

i 


into  (4.4.7) 


nanmetifwifitneni 


m 


FIGURE  4-10.  An  Example  Showing  The  Dependence  Of  The  Error 
Due  To  Discretisation  On  The  Curvature  Of  The 
Conditional  Mean  a.  And  The  Conditional  Variance  a 


five* 


(4.4.9)  <y*|S>  •  T  [<y*|x  -  <x|xek>,5>  {xek|s} 

k-lL 


.  v  1  dn<y  lx,5> 
n-2  nl  dx11 


x  ■  <x|xek> 


(x-x)n|xek,S>{xek|s)j 


If  all  tirau  of  n  >,  2  are  ignored,  then  equation  (4.4.9)  is 

equivalent  to  equation  (4.4.4),  the  usual  discrete  method  for 

finding  the  moments  of  (y|5)  .  A  similar  derivation  leads  to 

an  expression  for  the  discrete  approximation  to  (y|g}  itself. 

For  quadratic  conditional  moments,  as  in  the  two  earlier 

examples,  equation  (4.4.9)  reduces  to 
_  K 

(4.4.10)  <ymjs>  -  y  <y  lx  ■  <x j xek> , S> { xek | S } 

k-1 


+ 


1  d2<ym|x,g> 

2  dx 


<x  j xek> 


v<x|xek,S>(xek|s} 


Consistent  with  our  earlier  observations,  the  sign  and  magnitude 
of  thp  error  due  to  discretization  depend  on  the  curvature  of 
<ym|x,5>  .  Furthermore,  the  error  will  have  the  same  sign  in 
every  interval  regardless  of  the  marginal  distribution  {x|s}  . 

The  usual  method  of  discretization,  represented  by  equation 
(4.4.4)  approximates  the  conditional  moments  <ym|x,s>  by  a  piece- 
wise  linear  function  of  x  (Figure  4-11).  Equation  (4.2.2)  pro¬ 
posed  in  this  research  approximates  the  conditional  moments  by  a 
quadratic  function  of  x  .  Which  of  these  approaches  is  more 
accurate  depends  on  the  number  of  intervals  in  the  discrete  approx¬ 
imation  and  the  actual  shape  of  the  function  being  approximated. 
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<yjx,  s> 


FIGURE 


-ll.  Discretization . Approximates  Conditional  Moments 
By  A  Piecewise  Linear  Function 


CHAPTER  5 


Summary  and  Suggestions  for 
Further  Research 


Our  characterisation  of  influence  allows  the  decision 
analyst  to  conceptualize  the  relationship  between  the  probability 
distributions  on  different  variables  in  a  decision  model.  One 
can  think  of  an  influence  between  two  probability  distributions 
(x|s)  and  {y|s)  as  transforming  the  moments  of  one  distribu¬ 
tion  into  tha  moments  of  the  other  .  The  strength  and  type  of 
the  influence  can  be  measured  by  a  set  of  derivatives  denoted 
as 


(5.1) 


d<(y-y)m|s> 
d< (x-x)nJ  S> 


which  extends  in  an  obvious  way  for  n  =  1  and  rc  *  1  . 

Therefore,  the  influence  of  x  on  y  is  characterized  by 
an  infinite  matrix  that  has  its  n  ,  m  element  given  by  (5.1), 
and  is  denoted  by 


d(y 

S) 

dix 

5} 

This  influence  matrix  has  several  useful  properties.  First,  the 
matrix  is  null  if  and  only  if  the  moments  of  {y  |  S'}  are  unaf¬ 
fected  by  the  moments  of  {xjs}  and  y  is  probabilistically 
independent  of  x  .  Hence,  the  matrix  is  null  if  and  only  if  no 
influence  exists.  Second,  when  the  matrix  has  nonzero  elements, 
those-  elements  specify  the  type  and  strength  of  the  influence. 
Finally,  because  the  elements  of  the  matrix  follow  the  rules  of 


differential  calculus,  a  calculus  of  influences  appears  possible. 
For  example,  in  the  diagram: 


the  influence  matrix  of  x  on  z  may  be  computed  as 


d(z  S }  _  d{y  5}  d{z  5> 

ant fr  m  aixtii  aiypr 


Using  several  examples,  we  have  demonstrated  that  infsnce 
matrices  can  be  used  to  structure  decision  problems.  The  in¬ 
fluence-consequence  matrix  introduced  in  Chapter  3  shows  that 
the  elements  of  the  influence  matrix  can  be  used  to  determine 
which  areas  of  the  decision  model  require  further  modeling  and 
which  variables  should  be  treated  as  uncertain  in  the  decision 
model.  These  recommendations  amount  to  a  new  interpretation  of 
deterministic  sensitivity. 

We  have  also  used  the  influence  matrix  to  demonstrate  that 
there  is  no  single  correct  decision  model.  The  appropriate 
decision  model  depends  on  the  risk  attitude  of  the  decision 
maker. 

Finally,  we  investigated  the  theoretical  basis  for  discre- 
tizating  marginal  probability  distributions  to  compute  the  profit 
lottery.  Discretization  and  the  quadratic  method,  on  which  in¬ 
fluence  matrices  are  based,  differ  only  in  the  assumption  about 
the  functional  form  of  the  profit  lottery  conditioned  on  the 
state  variable.  Since  the  two  methods  are  comparable  in  case  of 
assessment  and  accuracy,  we  conclude  that  the  quadratic  method 
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should  be  considered  as  an  alternate  method  for  the  solution 
of  decision  problems  directly  from  their  influence  diagrams 
without  the  intermediate  step  of  constructing  a  decision  tree. 

To  develop  this  possibility  would  require  extending  the 
influence  theory  and  influence  calculus  presented  in  Chapters 
2  and  3  to  include  decision  variables.  We  illustrate  our  ap¬ 
proach  to  this  problem  with  the  following  example.  Consider  a 
decision  variable  D  influencing  the  profit  lottery  {y|D,S}  : 


Both  the  mean  and  variance  of  the  profit  lottery  will 
generally  depend  on  D  .  Limiting  our  attention  to  those  two 
moments,  we  write 


(5.2)  <y!d,s>  :  <y|Dn,S>  +  d-<y^g>g> 


(D  - 


V 


^  1  d  <y  D , S> 

2  7ZT 


do' 


v 


r  „  v  .  d  <vD, 5> 

<y  D,5>  ~  <y  D n,S>  + - - 


rin 


(D-D 


>?• 


0; 


(5.3) 


(D  -  Dn) 


where  Dq  is  an  arbitrary  nominal  setting  of  the  decision  vari¬ 
able.  Let  us  define  the  influence  of  D  on  (y|D,S),  analogous 
to  our  earlier  definition  for  the  influence  between  state  vari¬ 


ables,  as 


(5.4) 


dD 


dv<y|0,5> 
dD  " 


dv<y  I  D,5  > 


The  elements  of  this  matrix  can  be  obtained  by  an  assessment 
procedure  similar  to  that  discussed  in  Chapter  4. 


Now,  the  first  order  condition  for  the  optimum  decision 


D*  is 


<HS> 

dD 


or  approximately 


(5.5) 


4<yLD*g> 

dD 


1 

•  2  y 


«  0  . 


Expressions  for  the  two  derivatives  are  obtained  by  differenti¬ 
ating  (5.2)  and  (5.3).  Upon  substitution  into  (5.5),  we  obtain 
an  estimate  for  the  difference  between  Dq  and  the  optimum  de¬ 
cision  D*, 


(5.6) 


_  1  d  <y 1 D,s> 


D  -  D#  -  - 


d  <vlD.S> I 


1  d‘£v<vlD.S>l 


S 


Equation  (5.6)  suggests  that  tha  optimal  decision  can  be  deter¬ 
mined  from  tha  influence  of  the  decision  on  the  profit  lottery , 
equation  (5.4),  and  the  decision  maker's  risk  attitude.  In  fact, 
the  right  side  of  equation  (5.6)  is  the  ratio  of  the  elements  of 
the  influence  vector 

(5.7)  Cl  -  jt3t  • 

Of  course,  considerable  theoretical  development  is  required 
to  show  how  to  solve  general  decision  problems  from  the  influence 
diagram.  Our  simple  example  assumes  a  continuous  decision  vari¬ 
able,  which  has  derivatives,  but  in  practice  decision  variables 
are  often  discrete.  Furthermore,  our  simple  influence  diagram 
consists  of  a  single  decision  variable  and  a  single  state  variable. 
Research  is  needed  to  show  how  to  solve  sequential  decision  pro¬ 
blems  with  several  state  variables  by  the  influence  method.  An- 
(..*■  ?er  important  related  question  is  how  to  determine  the  value  of 
i  ' -irritation  directly  from  the  influence  diagram. 

Our  work  with  the  influence  method  for  state  variables, 
pres<  ited  in  Chapters  2,  3,  and  4,  and  our  simple  example  in  this 
cha.  ^r,  lead  us  to  believe  that  additional  research  and  experience 
with  the  influence  method  will  lead  to  more  developments  of  prac¬ 
tical  value  and  theoretical  interest.  We  encourage  further  re¬ 
search  in  the  application  of  the  influence  concept  to  decision 
problems . 
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Appendix  A 


A  Series  Representation  and  Approximation  for 
the  Covariance 

An  expression  for  Cov(x,y)  in  terms  of  the  moments  of 
(x|5>  can  be  obtained  by  writing. 


(A.l) 
(A.  2) 

(A.  3) 


Cov 


(x,y)  -  (x-x)  (y-y)  {x,y|S}  dydx 

■  (x-x)<y|x,S>{x|S}dx 


/ 


x<y |x,S>{x|S}dx  -  xy 


Expanding  <y|x,S>  in  a  Taylor's  series  gives 

(A. 4)  <y|x,S>  -  <y|xfS>  *  i  i  £sQbg> 

n-1 n*  dx11 


(x-x)n 


Upon  substitution  of  (A. 4)  into  (A. 2)  and  completion  of  the  in- 
tegration,  one  obtains 


(A.  5) 


Cov(x.y)  -  l  i,  —  =.«♦! 


n-1  *  dx 


<(x-x)“TJ-  S>  . 


When  <y|x,5>  is  linear  in  x,  the  covariance  is  equal  to 
the  first  term  of  (A. 3), 


(A.6) 


Cov (x,y) 


d< 


^|x,S> 


<x  S> 


This  expression  can  be  interpreted  graphically.  Equation 


A-l 


aas  njt  A*  AM  fwui  JIM  JUr  PwMIUC  MMMMTLirfA  M'A  kiunufma 


(A. 3)  show*  that  the  covariance  la  a  comparison  of  tho  axpactad 
araa  <y|x#S>  x  with  tha  araa  xy  .  Bacauaa  of  tha  linaarity 
of  <y|x,  >  ,  wa  hava 

<y |S>  ■  <y |x,S>  . 

Tha  varianca  of  (x|5)  can  be  interpreted  roughly  as  an  oscilla 
tion  of  x  about  <x|S>  ,  and  it  induces  a  similar  oscillation 
of  <y|x,5>  about  <yjx,S>.  Sines  tha  increase  in  the  area 
<y|x,£>  x  is  larger  when  x  is  greater  than  x  than  the  cor¬ 
responding  reduction  when  x  is  less  than  x  ,  uncertainty  in 
x  increases  the  expectation  of  <y|x,£>x.  The  amount  of  the 
increase  of  the  expectation  of  <y|x,S>x  over  yx  ,  which  by 
Equation  (A. 2)  is  the  covariance,  depends  on  the  slope  d<-jdXfg> 


Appendix  B 


A  proof  that  the  change  in  tho  cor  tain  equivalent  of  {ir|S} 
due  to  fixing  x  at  its  mean  ia  approximated  by 


3~<vlS>  v 
2v<x|S>  - 


<x|S>  . 


Taking  the  first  two  twerms  of  equation  (2.2.2)  for  m 


gives 


(B.l)  <ir|5>  z  <ir|x  »  x,S>  +  j  v<x|5> 


(B.2) 


<ir*|5>  2  <x*|x  *  x,S>  ♦  j  v<x(S> 


where 


h  .  a2<x|xts>  ,  h*  .  a2<*2]xts> 
xx  ^7  -  xx  a*1 


Using  (B.l)  and  (B.2),  we  obtain 


(B.  3) 


r<ir)S>  ■  <ir2|S>  -  <ir|S>4 


2  .  w  2 

<ir  jx  ■  x,S>-<w|x  ■  x,S> 


+  <T  hxx  -  ‘"I*  ■  x's>hx*-?hxx  V<xls»V<x|s> 


The  approximation  for  the  certain  equivalent  is 


(B.4) 


’<tt |S>  =  <ir|S>  -  J  V<w|S> 


Using  (B.l)  and  (B. 3)  in  (B.4)  yields 

(B.5)  V<x|S>  s  <u|x  »  x, S>  -  ^  (<w2|x  -  x,S>  -<n|  x«  x,S>2) 

+tjhxx  •  i<5hxx*<*lx-x>s>hxx‘}hL  v<xU>)]v<x|s> 


uirjAuuuj>,i 


The  first  two  terms  on  the  right  of  (B.5)  approximate  the  certain 
equivalent  of  it  when  x  -  x  .  Hence , 


(B.6)  ~<w|S>  ‘■<ir|x  -  x,S>  58 


[I  hxx 


i(Jhxx-  <"I*-J.5>hxx- 
j  l>xxV<x|S>)]  v<x|S> 


According  to  equation  (3.3.3),  the  influence  vector  is' 


d"<iT  S> 

-m-si 


d** <TT  5>  d**<TT  |5> 

.  d<xls>  dV<x I s> 


d  {  TT  5) 

air  it 


[*  •  H 


The  elements  of  the  influence  matrix  ^Tr-4r  can  be  found  in 


dix !  S 


Figure  2-4  and  used  in  this  equation: 


d‘’<irlS> 


hx  -  2<it |s>  hx 


t  h  i  h*  -  <tt  |s>  h 
2  xx  2  xx  1  xx 


[1  -  i  Y  ]T 


The  second  element  of  this  product  is 


(B.7)  V 


d"“<TT  I  S>  _  1  v  Y  ,1  u*  u  X 

dv<x|s>  1  xx  '  2  2  xx  "  1  ** 


Substituting  for  <tt|s>  according  to  B.l, 


(B.  8) 


d"<TT  |S> 
dv<x | S> 


t  h„„  -  l  (i  h* 


2  “xx  2  “xx 
1  hxx  "<*!*> 


U  -  <TT  I X  =  x ,  S>  h 


Multiplying  (B.8)  by  v<x|S>  and  comparing  with  (B.6),  we  find. 


d'*<ir|S>  v 

dv<x Js> 


<x|5>  -  J  V<x|S>2  Z  ‘*<ir|s>  -  ~<ir|x,S> 


Consequently ,  the  expression 

(B.9) 


V<x|S> 

d  <x|5> 


approximates  the  change  in  the  certain  equivalent  of  {tt|5}  due 
to  fixing  x  at  its  mean  value  provided  the  term 

i  hxx 


is  small.  If  it  is  not  small  it  can  be  added  to  the  expression 
(B.9)  to  improve  the  approximation. 
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